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Abstract 

Conventional PID controllers are used commonly in industry. 
However, under various circumstances such as changing 
process conditions, the PID loop does not necessarily 
perform in an 'optimal' manner, and retuning may then be 
required. Considering the large number of PID loops in 
industrial plants, an adaptive scheme, that allows the PID 
loops to be automatically tuned to accomodate changes in the 
process and/or the environment, is highly desirable. 

This thesis derives an adaptive PID(PI) controller from 
the synthesis of classical pole-placement design technique 
and modern control theory. The resulting controller has the 
following features: 

1. It is structurally and mathematically equivalent 
to a conventional discrete PID(PI) controller. 

2. It ensures both asymptotic servo and regulatory 
properties of the resulting closed-loop system 
in the presence of setpoint changes, noise 
and/or unmeasurable sustained load disturbances. 

3. It allows the use of adaptive feedforward 
control to improve the closed-loop regulatory 
response in the presence of measurable 
disturbances. 

4, It can handle unknown and constant or varying 
time delay systems. 

Feel tanismalgqourthnmica liven moli out. 


6. Its parameter estimation routine combines’ the 
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computationally efficient and numerically stable 
Usd factorization method with a variable 
forgettungs factors: 

7. It provides two on-line tuning parameters: a 
desired closed-loop pole location, and a value 
to form the variable forgetting factor. 

The algorithm is implemented on a HP-1000 digital 
computer to control the temperature of ae stirred-tank 
heater, which has a variable time delay. The evaluations 
focus mainly on the initial parameters to. start the 
algorithm, and the controller parameters. Results from both 
Simulation and experimentation show the superior performance 
of the adaptive PID(PI) controller as compared to the fixed 
gain PID(PI) controller. The adaptive PID(PI) controller is 
therefore a logical alternative to the fixed gain PID(PI1) 


controller, particularly when retuning is often required. 
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1. Introduction 


1.1 Introduction 

When sthewesystem =model! ism known, a =vaStmwanrayacr 
standard design techniques can be employed to generate 
different control strategies. Often, however, the system 
model is only partially known or even completely unknown. 
The design techniques then may incorporate some form of 
on-line parameter estimation technique. This leads to 
adaptive, or self-tuning control schemes. 

With an adaptive or “self-tuning “algorithm, “the 
controller parameters are continually updated from the 
estimates of the model parameters. An adaptive control 
System is therefore defined as a control system which can 
adjust its controller settings automatically, in such a way 
as to accomodate changes in the process it controls or its 
environment. 

This chapter briefly outlines the historical 
development of adaptive controllers, the different adaptive 
design techniques, and the developments in adaptive PID 


CONeTrols 


1.2 Adaptive Control 

Themmconcept.) OL adaptive: scontrole = system = was | ii1rst 
introduced in the late 1950's. The idea of model reference 
adaptive control (MRAC), for instance, was originally 


proposed by Whitaker, Yamron and Kezer [1958] and that of 
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self-tuning regulator (STR) by Kalman [1958]. Classical 
linear controllers were found to give Satisfactory 
performance only at a single operating condition. Motivated 
mainly by the design of autopilots for high performance 
aircraft and rockets over a wide range of flight conditions, 
research on adaptive control was very active in the late 
1950's. This enthusiasm soon diminished due to poor hardware 
and insufficient theory to fully analyze and understand such 
systems. 

During the 1960'S many new control theories were 
introduced. Among them were state-space based methods such 
as linear quadratic gaussian (LQG) techniques, stability 
theory, stochastic control theory, system identification and 
parameter estimation. Development of these theories has led 
to a better understanding of the design and operation 
principles of adaptive control systems, and provided the 
backbone to some of the more recent developments in adaptive 
conunoly 

Revived interest in adaptive control, however, did not 
begin until the major step forward made by Astrom and 
Wittenmark [1973] in self-tuning control theory, and the 
availability of inexpensive computer control hardware. Since 
then many adaptive controllers have been developed [Landau, 
1973 Martin-Sanchez, ©1974;8 GlarkegeandstGawthropye 1975; 
Goodwin, Radmage and Caines, 1978; Hoopes, Hawk and Lewis, 
1982: Hawk, 1983]. Recent surveyS on the subject include 


those by Seborg, Shah and Edgar [1983] and Astrom [1983]. 
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1.3 Design of Adaptive Control Systems 
The Sdesign’ ’of- °adaptive=™%control systems can be 
classified into two basic categories: 
lPeaGxplvciteor-indirectemethods 
26 Implicit or 9directemethoad? 
This type of classification is convenient and has’ been 
frequently used in the literature [Narendra and Valavani, 
VOLS se Seborgeesnahvand = Bdgarmetrge3 li] However; it 01s) not. as 
clearcut as may first appear. The two categories have been 
shown, from stability analysis, to be similar and in some 
cases identical [Ljung, 1978; Egardt, 1979]. 

In the explicit method, parameters of the process model 
with a pre-specified structure are estimated on-line 
recursively using the process input-output history. Design 
calculations of the control law are then based on the 
estimated model parameters. It is called explicit since the 
process is identified explicitly and the identified model 
Parameters are used ‘indirectly' to design the control law. 
It is clear, then, that as long as estimates of the model 
Parameters are available, almost any method can be used to 
design® the ‘control law. The explicit !method is therefore 
flexible with respect to control law design. A _ potential 
shortcoming of this approach is that the design calculations 
of the control law may require more computational time than 
that for the implicit method. 

In the direct approach the system is parameterized in 


such a way that the estimated parameters are also the 
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controller parameters, i.e. they are used directly in the 
control law. Design calculations of the control law are then 
not required. 

The different adaptive control schemes proposed in the 
literature can also be broadly classified into three main 
categories: 

In Those designed using stability theory, e.g. 
model reference adaptive control. 

2. Those designed by minimizing a quadratic cost 
Functions, (ner or. self-tuning regulators and 
controllers. 

32, Those designed from a pole-zero placement 
approach [Wellstead, Edmunds, Prager and Zanker, 
1979: Astrom and Wittenmark, 1980]. 

However, there is structural as well as mathematical 
equivalence between many of these algorithms. For example, a 
model reference adaptive Control ex, and self-tuning 
controller have been shown ton, Havess Stnuctural wand 
algorithmic similarities [Ljung and Landau, 1978; Landau, 
1979s Shahisand.. Fisher,;) 1980+) Egardt,. 1980J;...Connections 
between self-tuning controller and pole-placement controller 
have also been demonstrated [Gawthrop, 1977]. 

Despite the relatively mature state of adaptive control 
theory, few actual implementations of adaptive controllers 
in industrial type environments have been reported. One of 
the possible reasons for the lack of industrial applications 


may be the seemingly complicated structure of adaptive 
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controllers, as well as the unfamiliar theory of on-line 
identification and control. This has led to the development 
ofmadaptivetousself=tuning Spl Deecontrollers NGwhichtaatmers 
hoped will serve as replacements for the commonly used 
conventional discrete PID controllers LOE troublesome 
processes, ‘and’ as ‘a stepping=Stone® “for’ thevuse of more 


complicated adaptive controllers. 


1.4 Adaptive PID Controller 

Conventional feedback control systems typically include 
controllers of | the well-known PID type. This type of 
controller, when properly tuned to the process, performs 
very well. Many tuning schemes have been reported in the 
literature for tuning PID controller settings. Yet a large 
percentage of PID controllers in industrial plants are still 
found to operate in manual mode and badly tuned [Andreiev, 
OSes “Theres areldthree mainereasons forse thist erinsty Mose 
tuning techniques are based on optimization theory, e.g. 
Fletcher-Powell method with a quadratic control performance 
Grucentam@blsermann, +198 1)<#eThe tuning procedure can 
therefore be rather tedious and time consuming, especially 
when retuning is frequently needed. 

Second, most chemical processes are non-linear in 
nature. The linearized models that are used to design 
classical linear PID controllers depend, therefore, upon the 
particular steady-state operating conditions around which 


the processes are linearized. It is obvious then that if the 
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process Operating condition changes significantly, the 
controller settings must be retuned to give satisfactory 
results. Third, chemical processes are often non-stationary, 
e.g. process dynamics vary with a change in the process. For 
example, decay or ageing of catalyst activity in a reactor 
would require retuning of the controller settings, time and 
again, to achieve the desired closed-loop performance. 
Considering the large number of control loops in industrial 
plantsjh it Bis Sclear: fthatrfadadaptation gofs!the¥controller 
settings to accomodate changes in the process and/or its 
environment is highly desirable. 

In the past decade, the dramatic progress in computer 
technology has been accompanied by an extensive research 
effort in the development of adaptive control algorithms. 
Yet a recent review of applications of adaptive controllers 
[Parks, Schaufelberger, Schmid and Unbehauen, 1980] showed 
rather discouraging results and stated that, "the number of 
Significant applications is really quite small™ ... “reports 
on applications are thin and performance data from such 
systems even thinner". On “the “other ~hand;e the» level» of 
closed-loop control done by digital computers has increased 
enormously due to the rapid fall in the» cost of ©computer 
hardware. Most of them, however, are done by uSing very 
short sample times to 'mimic' the conventional analog PID 
controllers for several reasons: 

age They are the best understood, easiest to 


implement and maintain. 
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2. They are 'robust' and effective for a wide range 
OfMappiications. 
oes Lnaustrial processes are often strongly 
non-linear and tend to change in Lean 
unpredictable way. 
a Eine practice, Lit SsEokten difficultpercmeacectermimne 
a priori economic benefits for the applications 
obsmodern control, 
Although it has been demonstrated that a great advantage can 
be gained in some cases by using advanced multivariable 
controllers, there are many more cases in which improvements 
over fixed gain PID controllers can be obtained by using 
adaptive PID algorithms to compensate for changes in the 
controlled processes and the accompanying dead times. 
The presence of time delay in the controlled process is 
a typical characteristic of many process control problems. 
The existence of this time delay can greatly complicate the 
analytical design aspect of the control system. Moreover, 
time delay adds pure phase lag and thus reduces the 
Stability of the closed-loop system. To compensate for this, 
the controller gain must be reduced from the one which would 
be used for the same process without delay. Consequently, 
time delay also limits the achievable system performance. 
One of the most widely used time delay compensation 
techniques is the Smith Predictor control scheme [Smith, 
1957], since it can be used with any conventional regulator 


of the PID type. To design this controller, it is essential 
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to have a fairly accurate model of the process. However, 
penfect modelingias difficult tolfachievelin practice,e ul not 
impossible, due to process parameter variations. Any 
mismatch in the model causes loss of performance. This loss 
in performance can be reduced by including an adaptive 
mechanism to continually estimate the process model 
parameters and using these parameters to update the time 
delay compensator. This approach is known as the 
certainty-equivalence principle in which the controller is 
designed assuming that the estimated process model is the 
actual process itself. 

Time delay in chemical processes often appears as 
transport delay and varies with the process flowrate. 
Because time delay is a difficult parameter to be estimated 
on-line [White, 1976], Vogel [1982] proposed a dead-time 
compensator/controller which can adapt to unknown or varying 
time delay systems. Though it was developed independently, 
Vogel's dead-time compensator/controller can be shown to be 
a particular case of A&strom's design based on pole-zero 
placement technique [Seborg, Shah and Edgar, 1983]. 

Designo temadaptives "Control lers® ibasedmeon Sipole=zero 
placement method has been considered by many authors in the 
Miiteracure «mine particular this? vdeatias been popularized by 
Wellstead and his co-workers [Wellstead, Edmunds, Prager and 
Zanker, 1979; Wellstead, Prager and Zanker, 1979]. Their 
work focused mainly on the regulation problem. The use of 


feedforward control for measurable Gisturbances was not 
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discussed. In addition, their algorithm did not guarantee 
setpoint tracking. The use of feedforwarding the setpoint 
hor tracking was then included in the original 
pole-placement regulator [Wellstead and Zanker, 1979]. The 
resulting algorithm is capable of handling both servo and 
regulation problems at the expense of more computational 
effort. With the same aim, an extended pole-placement 
self-tuning algorithm was later proposed by Wellstead and 
Sanoff [1981]. 

Wouters [1977] proposed a stochastic pole-placement 
strategy. Again, his emphasis was on the stochastic 
regulation problem. The self-tuning controller introduced by 
Clarke and Gawthrop [1975 and 1979], as discussed by 
Gawthrop [1977], can be interpreted in a pole-placement 
framework. Astrom and Wittenmark [1980] also proposed a 
general procedure to design pole-zero placement based 
self-tuning controllers. Their work, however, focused 
entirely on the servo problem. 

Generally, adaptive controller design based on the 
quadratic cost function approach, e.g. self-tuning 
controller, or those based on pole-zero placement techniques 
do not have the structure of a conventional PID controller, 
especially for systems with time delays. Generating good PID 
controller settings from process parameter estimations was 
meportedm tomebes difficult [Vogel and Edgar, 1980]. Despite 
many papers in this area, the presence of a varying time 


delay in a process for the design of an adaptive PID 
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controller has either been ignored or was treated as known 
and constant. Design of simple self-tuning controllers based 
on the pole-placement method was discussed by Wittenmark and 
Astrom [1980] and Isermann [1981]. The algorithm. of 
Wittenmark and Astrom leads to a three-mode action 
controller and contains a memory of the previous control 
actions.) Calctlations\Moftthe™three PID®controlieresettings 
abémnotgexplicitY 9, and ‘therefore’ the® *three-mode ®action 
controller can be regarded as a generalized PID controller. 
An overview of these generalized PID algorithms can be found 
in the work by Harris, MacGregor and Wright [1982]. While 
Isermann's algorithm provides explicit equations to 
calculate the PID settings, the derivation was based on a 
pre-specified controller transfer function. By so doing, all 
the process zeros are forced to the origin of the z-plane 
excepteoneratez=1 Ftosform® san? Mintegrals actions controller. 
Based on phase and amplitude margins specification, Astrom 
and Hagglund [1983] also developed an automatic tuning 
procedure for funingG oOf@econventional Merl Desregqulators® 
Sele=tunrngmeof ePIDEScontrollersesertings™® *hasmevalso been 
duscussedmbyscouriploeanc = ompkinss | 1981] 9°Theyrcombined®the 
instrumental variable parameter estimation technique 
proposed by Touchstone [1975] and the Dahlin digital control 
funinguemethods [Dahliny"©1968)] Mto generate’ ethe@eadaptive 
algorithm. Moreover, the second parameter in the numerator 
polynomial of a second order process, 1.e. bz, 1SehOnCedm tO 


zero in order to obtain explicit equations for the PID 
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settings. 


Combining a continuous time process model and a 
discrete time adaptive controller, Gawthrop [1980] developed 
a hybrid self-tuner. Using this hybrid approach, Gawthrop 
[1981] also derived a self-tuning PI(PID) controller which 
enables the controller parameters in continuous form to be 
tuned by a discrete time estimator. This approach offers an 
advantage of avoiding non-minimum phase characteristic 
caused by discretization of the continuous process due to 
certain choice of sampling time or fractional part of a time 
delay. Banyasz and Keviczky [1982] also suggested an 
adaptive scheme to calculate the PID constants by using a 
gradient search method to enSure a pre-determined overshoot 
for the closed-loop step response. The scheme was recently 
extended to include a correcting term for non-minimum phase 
systems [Hettheéessy, Keviczky and Banyasz, 1983]. 

Cameron and Seborg [1983] presented a self-tuning PID 
controller based on a modified version of Clarke and 
Gawthrop's self-tuning controtlers The resulting PID 
controller has its proportional and derivative modes act on 
the filtered measurement and integral mode on the control 
error. Moreover, integral action is introduced by forcing 
the dynamics of the input variable. More recently a robust 
self-tuning feedback controller has been developed, which 
guarantees global convergence of the control error in the 
presence of bounded noise and/or unmeasured disturbances. In 


its simplest form, the self-tuning feedback controller is 
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mathematically and structurally equivalent to the discrete 
PID algorithm [Song, 1983; Song, Shah and Fisher, 1983]. 

Adaptive PID controllers have also appeared recently as 
commercial products in North America, Japan and Europe. For 
example, Leeds & Northrup Company introduced a self-tuning 
PID option into their new Electromax V Ssingle-loop 
controller [Andreiev, 1981]. Toshiba has also developed a 
controller which is capable of deciding the optimal PID 
constants automatically. Dedicated systems for specific 
applications such as cement kilns are also available 
[Seborg, Shah and Edgar, 1983]. 

The main theme of this work is to develop an adaptive 
controller with PID structure to handle unknown and/or 
varying time delay systems. The derivation includes 
Synthesis of the classical linear feedback control theory, 
i.e. pole-zero placement, and results of the modern control 
theory.) Slhiemeiajor distinctions “of this» jworkeeirom: the 
previous ones are: 

1. It presents a unified design approach, in a 
classical linear feedback CONbLOL theory 
framework, by considering both the servo problem 
and the regulatory problem. 

PAR OPA 85 allows the use of adaptive feedforward 
Control to improve the closed-loop system 
performance in the presence of measurable 
disturbances. 
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handling unknown and/or varying time delay 
systems. 

The controller has integral action which arises 
naturally from the assumption that the desired 
closed-loop characteristic equation can be 
represented by a first order polynomial. 

The algorithm is implicit since the estimated 
parameters are used directly as the controller 
parameters. 

TO avoid numerical stability problems with the 
recurSive computation of the covariance matrix, 
this study uses the Upper-Diagonal factorization 
method of Bierman [1976] to estimate the process 
parameters. In addition this study uses a 
variable forgetting factor to prevent 'blow-up' 
of the covariance? matrix, >) and ¥to®d controll’ Mthe 
speed of adaptation due to changes in the 
process and/or the environment. 


the adaptive PID controller proposed here can 


be used in two different ways: 
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1.5 Organization of Thesis 


Chapter 2 formulates the design problem and the 
necessary theory for the development of an adaptive PID 
controller based on pole-placement method. An adaptive 
feedforward compensation scheme is also included as an 
option to improve the system performance due to measurable 
disturbances. Theoretical derivations of the adaptive PID 
controller and adaptive feedforward compensator in Chapter 2 
assume that the process parameters are known. For processes 
with unknown and/or slowly changing parameters, an on-line 
recursive scheme iS required to estimate the process 
parameters and update the controller settings accordingly. 
Such a scheme is investigated in Chapter 3. Chapter 4 
discusses the results of implementing the proposed adaptive 
PTD controller on a Simulated model. Experimental 
evaluations of the adaptive PID controller with and without 
the adaptive feedforward compensator on a_e stirred-tank 
heater are presented in Chapter 5, followed by conclusions 


and recommendations for future work in Chapter 6. 
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2. Adaptive Pole-Placement Controller 


2. issLntroductron 

Adaptive control techniques were introduced to improve 
controller performance and, above. all, to eliminate the 
time-consuming manual tuning procedure of conventional PID 
controllers. However, adaptive controllers also have tuning 
parameters and they are oftentimes more difficult to tune or 
initialize than PID controllers. 

Based on these facts, the objective of this study was 
to develop an adaptive controller which is structurally and 
mathematically equivalent to a conventional discrete PID 
algorithm, and whose tuning parameters are eaSier to choose. 
Other considerations in this development are: (i) to ensure 
the applicability of the resulting controller to systems 
with unknown but constant or varying time delays and (ii) to 
ensure asymptotic closed-loop tracking and regulation. 

The following section presents a general approach to 
the design of a pole-placement controller. Simplification 
and refinement of this approach leading to the formulation 
Ofmanmadarptives PID controller isegiven in section 2.3.) Since 
it is a well-known result that feedforward compensation 
provides good disturbance rejection, the design of an 
adaptive feedforward compensator when process disturbances 


are measurable is considered in section 2.4. 
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2.2 Theory 


Consider a single-input single-output process which can 


be characterized by a linear, discrete ARMA model: 


Ze OLR (footie) Ze St Ge> 1) 
y(k) = —m——— ul(k) + ——— v(k) + E(k) (2.1) 
Piz es) Rez) 


where u(k), y(k) and v(k) denote the process input, output 
and measurable deterministic disturbance respectively. £&(k) 
is the residual which accounts for the effects of unmeasured 
disturbances, process and/or measurement noise, modeling 
Errors” process mon-lineanmitiesip etc.c.oF ids andwitiee are the 
corresponding time delays written in terms of sampling 
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is the backward ‘shift operator, i.e. =z 'y(k) 
= y(k-1), and the polynomials A(z~'), B(z ') and L(z~') are 


defined as: 
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However, equation (2.1) can be rewritten in a more compact 


form as: 


y(k) = ——— u(k) + ——— v(k) + &(k) (23) 
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This system description does not require an explicit 
estimation of the time delay and allows a maximum time delay 
of dvand@yeasampling intervals. tor bel Sconsidered: = iniethe 
process and the disturbance polynomials respectively 
[Wellstead and Sanoff, 1981]. Ideally, the leading d and j 
coefficients of the corresponding polynomials B(z~') and 
L(z~') will be zero or close to zero for time delays of 4d 
and j sampling intervals. 

In the derivation of the adaptive controller’ the 
measurable disturbance berms 12S “initially, omitted | tor 


Simplicity. Equation (2.3) then becomes: 


) 
y(k) = —— u(k) + &(k) (225) 
2) 


where y,(k) is the process setpoint; the polynomials ghia by 


G(z-') and H(z~') are defined as: 
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According to pole-placement criterion, the coefficients 
GreDOLyHOMal Sesh (ze) eG (zee mandaHiz>) are determinedein 
such a way that the desired closed-loop transfer function of 


the given system can be represented by 
( 
y(k) = —— y,(k) + —— £(k) C2n0)) 
( ( 


The polynomials X(z~'), S(z~') and W(z~') are chosen by the 


designer and defined as 
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such that at steady-state (as k > ~) X(z°')/W(z~') = 1° and 
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Figure 2.1. Block diagram of a closed-loop system. 


and that relating y(k) to y,(k) can be written as; 


Bie joel ua) 
y(k) = -—  —_  . Ck) PS, 
Pez G2) ee ce ch 


Equating equation (2.40) Seance Equation. C2.) tom Ene 


corresponding parts of equation (2.8) results in: 
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Now the design problem is reduced to the algebraic solution 
SELequat Konsep02-. 12) eeandse (2543 }eetorefind. the! controller 
polynomilars SOF(z 9h) merG( 2!) etand Hizia])¢eprovidingmthapethe 
polynomials A(z~') and B(z~') are known and _ polynomials 
Stage; bX(2i' eandsw(zp!)) areupre-speci fied. 

Equation (2.12) displays the heart of a pole-placement 
approach, ree.) the ‘oniginal fcleosed-loop characteristic 
equation described by the left hand side of equation (2.12) 
mstuneplacedw by ethate ofs thewaright. hand” }sideiarrom the 
Stability analysis of feedback systems in classical linear 
feedback control theory, it is a well-known result that the 
Stability characteristic of a feedback system is determined 
by the pole locations of its closed-loop characteristic 
equation. Therefore, as long as the roots of the right hand 
Side polynomials are inside the unit circle of the z-plane, 
the overall feedback system will be stable. 

The design procedure described above, however, is not 
without shortcomings. The resulting algorithm is explicit 
and its implementation requires three steps at each sampling 
intervals: i) on-line estimation of the process model 
parameters, equation (2550). tn) calculation of the 
controller parameters from equations (2.12) and (2.13); iii) 
determination of the control input from equation (2.6). 
Therefore, adaptive scontrollersisebased ~ on this design 
approach usually require more computational effort, since 
equations (2.12) and (2.13) have to be solved at each 


sampling interval for the coefficients of polynomials 
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F(z~'), G(z~') and H(z~'). In the sequel, certain procedures 
will be employed to remove this requirement, i.e. to design 
a computationally more efficient implicit algorithm, and at 
the same time derive an adaptive controller with@ina 


conventional discrete PID structure. 


2.3 Derivation of An Adaptive PID Controller 

The question which often arises in pole-placement 
method is how to choose the polynomials S(z°~'), xX(z~') and 
W(z"'). The answer to this question has not been dealt with 
explicitly in the literature, and the polynomials S(z™'), 
X(z~') and W(z~') are often referred to as the polynomials 
describing the ‘desired closed-loop system'. In general, it 
tSamround sethatvsany "particulartmsolutionsmeange bey obtained 
depending on the design objectives to be achieved. The 
following treatment demonstrates how this can be done. For 
the specific case here, the design objectives are: 

1. To design a pole-placement controller such that 
no process zeros are cancelled. 

2. To obtain a simple and practical controller such 
that design effort and computational time are 
minimum. 

Se, Ms, obtain a controller with conventional 
discrete-time PID structure. 

4, To have a system Wich good asymptotic 
closed-loop tracking property, i.e. y(k)/y.(k) > 
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> mor lOMeanave a system with good asymptotic 
closed-loop regulatory property, i.e. y(k)/&(k) 
> 0m ast kyo ie), 

6. To be able to handle unknown and/or changing 
time delay systems. 


Now consider the following choice of S(z~'): 


SC (Zany 


where K, 1S a constant whose value will be determined in the 
sequel. The reasons for this choice of S(z~') are: i) to 
Simplify the solutions of equations (2.12) and (2.13); ii) 
to reduce computational time as the determination of G(z~') 
will also depend on how S(z~') is specified; iii) to obtain 
asymptotic regulatory control. How S(z~') effects this later 
objective will become clear in the discussion to follow. 
Making use of this choice, equations (2.12) and (2.13) 


reduce to: 
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H(z-') =| ————— (22 a6) 
B(z ) 


Solving for the coefficients of polynomials EAiZene) eeeaniG 
G(z-'!) from equation (2.15) yields a set of simultaneous 


equations. Mathematically, it is also clear that equation 
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(2.15) is solvable only when the matrix formed by the 
coefficients GE Spolynomials SA(za') and Blze )eeisenot 
Singular. An iterative algorithm to solve equation (2.15) 
asymptotically was proposed by Elliott and Wolovich [1979], 
and Kreisselmeier [1980]. Their approach, though seems to 
alleviate the matrix singularity problem, is computationally 
Unattractivee@ @nGipracticalseapp! tcatbonsmasands willaesti lt 
encounter the same difficulty when matrix singularity occurs 
[Goodwin and Sin, 1984]. An alternative is to choose one of 
two polynomials. Solution for the other will then be unique, 
and solving of the simultaneous equations and the difficulty 
due to matrix singularity can be eliminated. Different 
choices of the polynomials will inevitably lead to different 
closed-loop properties. In this work, polynomial F(z™') is 


chosen and given by: 


Pidzem=, kK MAC ZS") (2g) 


where K, is a constant and the choice of its value will be 
BxplainedamshortiysaeThis!achoicemtotegpolynomial te: (zaymis 
significant in the outcome of the resulting algorithm. Since 
F(z-') is the feedback controller polynomial and A(z™') is 
the process output polynomial, estimation of the process 
model parameters in an’ adaptive control ‘context «will 
directly determine the controller parameters. Similarly, the 
result is extended to polynomial G(z~'), as substitution of 


equation (2.17) into equation (2.15) yields: 
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Where W(z'') is user specified and B(z~') is the process 
input polynomial. 

Galeculation ¢ofmithefcontrol Law, fequation! 6286) 18ers snow 
tet uEwnthethe determination of H(z=") from equation (2.16). 
In order to avoid cancellation of the possibly unstable or 
poorly damped zeros of the system, the choice of polynomial 
X(z~') is made such that the desired closed-loop zeros are 


the process zeros, i.e. 


This choice of X(z°~') therefore offers an advantage to the 
resulting pole-placement controller in handling non-minimum 
phase systems. However, it should not be assumed that 
knowledge of the process zeros is required a priori since 
polynomial B(z~') can be estimated on-line in the estimator. 


Substitution of equation (2.19) into equation (2516) )gives 


H(Za ako A(z) (2220) 


Brom meqduatdons——-(2srh/)sse(2ael GO) wand= (2.20), 1t isacleax 
that the controller parameters are all expressed in terms of 
the process parameters. This type of algorithm is called 


IMDLIcrteOrsaiurect. 
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The values of K,; and Kz can now be determined by 
considering the design objectives, i.e. the controller 
should have good asymptotic tracking and regulatory 
PROperviesy PrESRequations” (2914).,1E028d8 en anal Woeno) are 


substituted into equation (2.8), the following equation will 


be obtained: 
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K, w(z>) 
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and the control law becomes: 
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determination of equation (2.24) only requires user 
Specified closed-loop poles, i.e. polynomial W(z-'). For 
high order systems, it may be difficult to specify all the 
closedeioop poles.) Alsos | its mays be impractical to model the 
process with a high order model from computer storage and 
computational time viewpoints. In most cases, at is 
Satisfactory to model the process by a second order plus 
time delay model or a first order plus time delay model, and 
to specify only the dominant poles. 

In practice, it is desirable to have a simple yet 
effective control law, t@ esoneGPIDstcontrol BlaweeGaA BRID 


controller in its velocity form may be written as; 
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Equation (2.25) is one of the various forms of conventional 
digitalam@PlDiecontrolgt law usedlin lateratures|Phelantaa 97a; 


Isermann, 1981]. Rearranging this equation gives: 
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Since the setpoint appears only in the integral term, this 
particular form offers the advantage of avoiding derivative 
kick and large proportional action at the time of making a 
setpoint change. 
Bquatvonm.(224) is identical to equation (2:26)ea £. 
1. The process can be modeled by a second order 
plus time delay model, i.e. 
AGzcel) team Mt at, ir Wate we 
B25) Bawa. 4) ty vest ees pees Za meio a) 
2. The steady-state approximation can be used such 
Eats: 
PiGZpl eyo = ae Vera a) G2) 83) 
Bi Zee) wee (2.29) 
3. Wiz?) can be quantified by a first order 
polynomial, i.e. 
Wi gos) mea etaw zo (2530p 
The last condition makes the order of (K, A(z") W(z~')) in 
the closed-loop equation (2.15) become less than that of 
CAzmen Giz) a+ eB (2 eu) F (Ze) )eeelhis ampliessthat athenesare 
common factors which cancel. If equation (2.10) is equated 
to thessecond part.of equation, (2.6), and at the  Samee@time 
using the result of equation (2.14), the following equation 


will be obtained: 
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The common factor which cancels is polynomial Q(z~') and the 
roots of this polynomial are therefore assumed to be in the 
Stable region. Moreover, this common factor Q(z~') can be 
interpreted as the observer polynomial since the control law 
in equation (2.6) can be shown to be a combination of an 
observer and ae_e state feedback law [Astrom and Wittenmark, 
1980]. 

Using the three conditions stated above, equation(2.24) 


becomes: 
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The three PID controller settings are generated by comparing 
the coefficients associated with each term of the variables 


in equation (2.32) and equation (2.26). They are: 
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Many different techniques have been introduced to add 
an integrator into the control law. Some of these 
approaches, however, do not provide zero steady-state offset 
for sustained load disturbances [Morris, Nazer and Wood, 
1981]. It should be noted that equations (2.29) and (2.30) 
have naturally given rise to an integral action in the 
Control law, equation (2327 More specifically, 
substitution of equations (2.29) and (2.30) into equation 


(een Smee reG Uz gives: 


1 1 
ae Sen eee (2.40) 
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where a discrete pole at z=1 corresponds to an integrator 
and gives infinite gain at constant inputs. In addition, 
equation (2.30) has reduced the user specifications to 


placing only one dominant pole. 
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2.4 Derivation of An Adaptive Feedforward Compensator 
Feedforward compensation for any measurable 

disturbances can be incorporated into the adaptive PID 

control scheme described in the previous section. Consider 


the following block diagram: 


Figure 2.2 Block diagram of a closed-loop system with 
feedforward compensation. 


where bez as)/net2z  ") Gre *8thes@itransfer function ‘of the 
feedforward compensator that needs to be determined. 


The closed-loop transfer function relating y(k) to v(k) 


is expressed as: 


Ben gaa) 
g(z-')[L(2"") yearn aneee B(2"") | 
Bee By 
yk) = i(k) (paagD 


A (or PS" ) SEB zee Ser (ere) 


arm botintia sae or bs retot 


vebianed? .Actisee  euciveso ahs “eer = 


ioiw Gasaye abi i 6 Yo on 7paee Mootle &.§ 
ruiggedeymes &1 .avEd? fra} 


- 
afi So «oigedGto setanb7? - sit ‘ee ("-2biaKt" “SY 9 
-Senimia36b 26 oO: abeon tan? soTseregmes ore 
(ae ontaeter ngitzony? ve}anas? geni-beaot> § : 


3 


The feedforward compensator is to be designed in such a way 
that the process output y(k) will be unaffected even in the 


presence of sustained load disturbances. It is therefore 


desired to have: 


6(2-") [L(2-") + B(2~')| ai (2.42) 
Eguze!) 
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The feedforward component, u2, of the total control signal, 
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u2(k) = - —— v(k) (2.44) 


and the overall control signal is: 


Ui Atk) eee. ( kesh quia, (ke) (2.45) 


where u(k) is determined from the feedback control law given 
bygequaton(2, 3i2)r 
Since the simplest form of a feedforward compensator is 


the one with a single gain term, equation (2.44) can be 
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rewritten by employing the steady-state approximation. This 


thus reduces to: 


The design procedure has been described under’ the 
assumption that the process dynamics and environments of the 
system to be controlled are known, i.e. model parameters are 
given. For processes with unknown parameters, the model 
parameters can be simply replaced by their estimated values. 
This approach is referred to as certainty-equivalence 
principle in which the estimated model is regarded as_ the 
actual process. The design is therefore separated into two 
steps: identification and control. Estimations of the model 
Parameters can be carried out on-line recursively by any 
standard method to form the adaptive algorithm. The scheme 


used in this work is presented in the following chapter. 


2.5 Summary 

This chapter has described a general approach to 
pole-placement design, and in the same vein derived an 
ImMpbTe tt PID(PI) control algorithm. With an on-line 
estimation routine, the algorithm can be _ used as a 
'stand-alone' adaptive controller, or a retuning algorithm 
for the existing conventional digital PID(PI) controllers, 


Since the controller settings can be explicitly determined. 
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In addition, it includes an on-line tuning parameter, w,, to 
allow the operator to provide the controller with a 
knowledge of the desired closed-loop pole location. The last 
section presents an optional, Simple adaptive feedforward 
compensator to be used with the adaptive PID(PI) algorithm 


in the presence of a measurable disturbance. 
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3. Parameter Estimation 


3.1 Introduction 


In most practical problems there is seldom sufficient a 
priori knowledge about a system and its environment to 
design a control system. In automatic control, however, it 
is often possible to identify the system and obtain the 
missing information by performing experiments on the system. 
Nevertheless, there are uSually severe limitations on the 
experiments that can be performed in practice. The 
experiments are often required to be performed during 
"normal' operations in order to get useful results. This 
implies that pertubations on the system, if any, must be 
small such that the overall production line is undisturbed. 
Extra regulators might be needed to keep the _ process 
fluctuations within the acceptable limits and these in turn 
might create an influence on the estimation results. 

Even in classical control theory, fforythe design of 
PVC eCdmecainmerlD | CONtIO. ens ameocome methods of system 
identification are required, e.g. Bode diagram or Nyquist 
Stabi WitysanalysiswaThis tchaptersdeals particularly withethe 
identification scheme to be used with the control strategy 
presented in Chapter 2 to formulate the adaptive algorithm. 
For parameter estimation purposes, the system model 


described by equation (2.3) is rewritten as: 
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feedforward compensation is included) are to be estimated 
from the process input, output and measurable disturbance 
histories. y(k) is the estimated output of the process y(k). 

inwivectortntorms mr eequationen(3 wbesecan be written 


compactly as: 
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During the past two decades the field of system 
identification and parameter estimation has developed 
rapidlyssdue to “its* broad applicability in many different 
areas, adaptive control in particular. There are a number of 
different schemes proposed in the literature that can be 
used to perform parameter estimation for the type of process 


model described by equation (3.3). A few of these are: 
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- Recursive learning method (RL) 

= Recursive least-squares method (RLS) 

- RecurSive instrumental variable method (RIV) 

- Recursive extended least-squares method (ELS) 

e Recursive generalized least-squares method (GLS) 

= Recursive maximum likelihood method (RML) 

= Recursive square-root method (RSOR) 

= Recursive upper-diagonal factorization method 

(RUD) 

An overview of the theoretical backgrounds and comparative 
Studies of these schemes can be found in the literature 
[Nagumo and Noda, 1967; Eykhoff, 1974; Bierman, 1976; 
Soderstrom, Ljung and Gustavsson, 1978; Ljung, 1977a, 1977b, 
1981; Isermann, 1981; Wong, Bayoumi and Nuyan, 1983]. This 
work uses a recursive least-squares method with U-D 
factorization algorithm and a variable forgetting factor. 
Simulation and experimental results show the success of this 
combination. AS a matter of fact, the recent comparative 
study by Wong, Bayoumi and Nuyan [1983] shared this same 
conclusion and stated that, "RUD factorization combined with 
a variable forgetting factor possesses superior properties 
... RSOR and SOR with householder transformation methods may 
cause parameter drifting ... conventional RLS method should 
only be used with caution in identification and control 
especially when the forgetting factor is less than one". To 
provide further appreciation of this choice, a discussion 


including illustrated examples is presented in the following 
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sections. 


3.2 Recursive Least-Squares Method 

Among the various recursive identification methods the 
conventional Kalman filtering, or better known as recursive 
Heaste squares eestimation,’ © ish thessmostupopularedtiemto its 
compact representation, computational efficiency and 
frequent appearance in the literature. Together with 
equation (3.2) the recursive least-squares algorithm is 
given as: 


Predicted output: ¥(k) Ve 1 OiGks 1 ) (3.4) 


Pike) eat ke) 


Gaumecalculation~a.c(k) (3.5) 


[1 + wt(k-1) P(k-1) W(k-1)] 
Pacanerertestiumat ones 6 (iki)me s6iikoiie) tere k)iliv k JeayGk palm (3% 6) 


Covariance update: P(k) = [1 = K(k) Ww (k-1) JB(k-1) Cee) 


where y(k) and ¥(k) are the process output and the predicted 
output respectively; wik} "is the input-outputs svector 
containing the process input, output and disturbance 
sequences; OU )eeis) was “VECCOLmeCcONtalnd 10) meuneG ss panamnet er 
estimates and often referred to aS parameter vector; x(k) is 
the estimator gain vector and P(k) is the covariance matrix. 

If the standard recursive least-squares (RLS) method is 
applied to identify systems with correlated or coloured 


noise the estimated parameters are biased. This bias can be 
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removed by applying recursive instrumental variable (RIV), 
recursive extended least-squares (ELS), recursive 
generalized least-squares (GLS) or recursive maximum 
likelihood (RML) at the expense of more computational 
effort. When RLS is applied to estimate model parameters for 
adaptive control systems, it is often a question whether the 
accuracy of the estimates should be judged on the premise of 
deviations in the model parameters or in the overall system 
péerflormance #01 f'the final \ourpose*of identification m@els= eto 
design a control system it seems reasonable, then, to judge 
the accuracy of the estimates on the basis of the overall 
performance of the control system. Despite its biased 
estimates, RLS is still the most popular method in the 
literature because of its Superior convergence properties. 
Parameter estimation when used in the context of 
adaptive control has also encountered other problems. For 
example, system identification and parameter estimation 
theory assumes persistent excitation of the input signal to 
the process being considered [Eykhoff, 1974]. This 
assumption, though seemingly not very crucial, was shown to 
belione fof “tthe “conditions necéssary for "the ~'closed-loop 
System identifiability [Gustavsson, Ljung and Soderstrom, 
1977+ .8lsermann, 1982] and in some cases, exponential 
convergence of the estimation and control algorithm 
[Anderson and Johnson, 1982]. For processes with low noise 
characteristics such as chemical processes, the input signal 


is not guaranteed to be persistently excited to give valid 
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parameter estimates. When the system lacks sufficient 
excitation for a long period of time, e.g. when the initial 
excitation has been smoothed out, a phenomenon called 
parameter drifting may occur. More specifically, the term 
P(k-1) W(k-1) in equation (3.5) will be zero. The gain x(k) 
inmuedua thiong (395) \sand» thence *hthepetermacn( k) eet (koh) ein 
equation (3.7) will also be zero. As a result, the parameter 
estimation vector @6(k) remains unchanged even if the 
Buccuc tucnmerron,. ise. vy (k)e = eey(k) mise alarnge amesim larly. 
there will be no change in the covariance matrix P(k) in 


equation §(327)- héec PR (k) = oR (k= 1)-. 


Example 3.1 
Consider a second order system with poles at -0.33 and 
a0. 2 in the s-plane described by the continuous-time 


transfer function: 


y(s) 1 
ee Gae8) 
u(s) (Bene (SStan))) 


Sampling this system with a sampling time of one, the 
discrete-time input-output relation along with a zero order 
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This same model with a time delay ranging from 1 to 5 will 
again be used as an illustrative model in Chapter 4. 

The adaptive PID control law was combined with RLS to 
control this system to track a unit setpoint trajectory. The 
setpoint change was made at k=50 and the length of 
Simulation was 700 iterations. The covariance matrix and the 
gain were initialized to 10*I and zero respectively. 
Simulation results at different intervals are shown in the 


table below: 


Table 3.1. List of Covariance Matrix and Gain Using RLS 


Iteration # | Covariance Matrix, P(k) \g@Gain? K(k) 
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It is clearly shown in Table 3.1 that the covariance 
matrix and the gain decrease gradually from k=50 to k=350. 


Moreover, as time increases the covariance matrix remains 
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relatively constant while the gain reduces to a value close 
to zero aS expected. This situation is not very desirable in 
a 'real' system even though the output variable may be 
tracking the desired trajectory very well. If there is any 
estimation error due to disturbance, changing time delay, 
changing process’ igainatete ss ling the system! @therestimated 
parameters will not be updated because of the small gain. 
Consequently, the controller settings which are basically 
based on the values of parameter estimates will remain 
unchanged. Under this circumstance the controller has lost 
its primary purpose of adapting to the process and tuning 
its settings automatically. In the worst case, the system 
can even go unstable. It has been suggested in the 
literature that this situation can be avoided by introducing 
an additional perturbation signal, or by using a_ forgetting 


factor to inflate the covariance matrix. 


3.3 Forgetting Factor 
Piawaeecorgetting Sfactonamtcm@., introduced @intow RUS Eto 
discount past data when performing the estimations, Equation 


(3.7) can be rewritten as: 
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In practice, the use of this forgetting factor offers 
additional advantages such as: 
to #Since most chemical processes exhibit 
time-varying and non-linear dynamics which 
violate the design assumptions of linear and 
time-invariant systems, a forgetting factor of 
less than 1 discounts past data and prevents the 
recursive estimator from converging such that it 
1S able to follow changes in the system due to 
time-varying and/or non-linear characteristics. 
Z.eelne= Capability gto conerol the Speed of 
adaptation. 
However, the choice of this constant value forgetting factor 
can be critical. It has been reported in the literature 
(Morris, Fenton and Nazer, 1977; Astrom and Wittenmark, 
1980: Fortescue, Kershenbaum and Ydstie, 1981] that if this 
value is not chosen carefully, it can lead to an exponential 
growth of the covariance matrix and a_ system which is 


extremely sensitive to disturbances. 


Example 3.2 

The same system described in example 3.1 was again 
Simulated with w=0.8. This value of forgetting factor was 
chosen to induce faster blow-up phenomenon. The covariance 
matrix and the gain were initialized to 10°I and zero 


respectively. Simulation results are given ingiablemts aa" 
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Tables, 2. List of Covariance Matrix and Gain Using RLS 
With Constant Forgetting Factor 


Iteration # | Covariance Matrix, P(k) | Gain,x(k) 


overflow occurs 


From Table 3.2, it is seen that the covariance matrix 
had increased from the order of 10° at k=1 to 10'° at k=50, 
as there was little or no information about the system 
dynamics during long periods of steady-state operation. When 
a unit step change was made in setpoint at k=50 the 
covariance matrix decreased slowly and reached an order of 
10° at k=65. However, once this major excitation was over, 
the magnitude of the covariance matrix grew again with time, 


as depicted from k=65 to k=92 in Table 3e2¢ 
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Theoretically this can be explained as follows. The 
negative term on the right hand side of equation (3.10) 
corresponds to the amount of reduction in parameter 
uncertainty from the last measurement. When the major 
excitation 1S over, i.e. setpoint change or load 
disturbance, there will be no changes in the parameter 
estimates sand ther term’ P(k=1) ~Ck-1) ®in=equattone( 3.5) saws it 
be zero. Consequently x(k) will be zero and so will be the 
negative term on the right hand Side of equation (3.10)7° At 


this point, equation (3.10) is practically represented by: 


1 
P(k) = — P(k-1) (en 
Uu 


The covariance matrix P(k) will therefore grow exponentially 
if uw is less than 1. A large covariance matrix may also 
cause numerical problems . The numerical problem encountered 
in this simulation was mainly due to the accumulated effects 
of ‘roundoff error. At iteration 93, the term W*(k=-1) P(k-1) 
w(k-1) was rounded to -1 such that the gain determined by 
Gudacvonm(3e5) "was “indefinite. Besides the diihicultysor 
choosing a strategy to determine the forgetting factor, the 
accumulation of roundoff error is the most important 
disadvantage of using a forgetting factor scheme, and may 
also lead to negative eigenvalues in the covariance matrix 
[Ydstie and Sargent, 1984]. The former problem will be 


solved in the following while the latter will be further 
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discussed in the next section. 


There are many ways suggested by different authors to 
eliminate the exponential growth of covariance matrix. For 
instance, the use of an additional perturbationusignaleve.ogz 
Pseudo Random Binary Sequence (PRBS), to ensure that the 
process is properly excited. Other possibilities are to stop 
the covariance updating when the prediction error is within 
a given bound, or to use an upper bound on the diagonal 
elementsig offethe ecovarianceiamatrixgor theiretrace, Though 
these techniques have shown some success, there are 
practical difficulties like determining the @ priori upper 
bounds on the diagonal elements. If a measure for the 
information content in the estimator can be defined and 
related to the forgetting factor, it seems possible then to 
determine a forgetting factor such that the covariance 
matrix Stays bounded. This leads to the idea of using a 
variable forgetting factor [Fortescue, Kershenbaum and 
Ydstie, 1981; Wellstead and Sanoff, 1981; Isermann, 1982]. 
This work uses the scheme proposed by Fortescue, Kershenbaum 
and Ydstie [1981]. Incorporating this into the RLS algorithm 
described in the previous sections, the term uw in equation 


(3.10) becomes a variable and is given by: 


[1 - wt(k-1) «(k) Jé?(k) 
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No corresponds to the nominal asymptotic memory length and 
controls the speed of adaptation. A small value of No 
corresponds to a large covariance matrix and a sensitive 
System; a large value will result in a less sensitive system 
but slower adaptation. é(k) is the @ posteriori estimation 
Srror.eA Sialiglienror = Canesebessinbernpreted .aseeca thera tne 
process has not been excited, e.g. the first 50 iterations 
in example 3.2; there has been an excitation and the 
parameters Shave = converged @ ito “’aw ‘Set-) ofelivalues> Sormitne 
estimator has significantly reduced the estimation error. In 
all these cases, a small a posteriori estimation error will 
Lesubteaineastorgetting ‘Lactorsvaluestclose) tous svequation 
3.12). On the contrary, a smaller forgetting factor will be 
obtained when the a posteriori estimation error is large. 
Convergence of RLS algorithm with a variable forgetting 
factor can be found in the work by Osorio Cordero and Mayne 
[1981] for a deterministic case. 

From the viewpoint of programming and computational 
time, direct implementation of equation (3.12) is not very 
attractive. However, this implementation can be simplified 
considerably by replacing x(k) with equation (3.5). The 


identification algorithm can then be written as: 


Predicted output: 7(k) gk alo. ata) Unio) 


Estimation error: é(k) vidk aves) (3... 16) 
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Buk = 
Gain calculation: x(k) = eo ee 3a a) 


[C1 + wt(k-1)P(k-1)W(k-1)] 
Batamerereestimation: 6(k) = @(k=1)ee (kk) elk) (32418) 


Forgetting factor: 
é?(k) 
u(k) = 1 —_ (earatio)) 


Pee pet keee Pk) Wt ko toa ae 


Covariance update: 
1 
a) = [aes Chat) WU eki=) Pika (359201) 
u(k) 


Though equation (3.19) seems to be more complicated than 
equacionms.i2),. a closer look reveals) that. thesterm iat 
Jacko) eP Koji wCKk—1) ) 1s) sfirst. caloulatedasins equation 
(3.17) and can be stored in the computer for use in equation 
(3.19). Programming and computational time wise, the 
variable forgetting factor described by equation (3.19) can 
now be implemented with one line of FORTRAN code. 

The implementation of the above estimation algorithm 
with its order of execution as written needs a lower bound 
for u(k) to prevent its value from becoming too small or 
negative. This’ limit does not need to be specified if a 
mathematically more involved algorithm is used. In such a 
case, u(k) 1s solved £rom a quadratic relationship and it is 
done before themeupOdt 10 Cm O PRU Nem—Gdilmec NOM pala ine Gel 
estimates. The practical difference in performance of the 
resulting algorithm is indistinguishable from the simple one 


[Fortescue, Kershenbaum and Ydstie, 1981; Kershenbaum, 
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1983]. 


In addition, the implementation of variable forgetting 
factor requires a priori specification of Se This 
specification allows the operator to control the speed of 
estimator adaptation. From the simulation and experimental 
studies, it was found that the choice of Zp did not appear 
to be very sensitive. However, too low a value of £5 could 
eageetogmunstable control, When Zo was) too small, ithe 
forgetting factor was found to remain near the minimum 
DINU ast tet hniscmecontunued £orgagbong period of times ticould 
lead to the blow-up of the covariance matrix (equation 
3.11). More discussions on this matter are given in Chapter 


4 and Chapter 5. 


3.4 Upper-Diagonal Factorization Method 

Another problem associated with the conventional RLS 
algorithm presented in the previous section is_ the 
possibility ofshaving indefinite, negative “eigenvalues sin 
the covariance matrix. This numerical problem is often due 
to the high dimension of the covariance matrix and/or the 
accumulated effects of the roundoff error caused by the 
fangdtes wocommlength eof them—=computer eis ¢e.efa hardware 
limitation. Numerous examples illustrating the numerical 
stability problem of the RLS algorithm can be found in the 


literature [Kaminski, Bryson and Schmidt, 1971; Bierman, 


1926 and 497473). 
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Potter, who applied the recursive covariance filtering 
to spacecraft navigation, observed that propagating a square 
root of the covariance matrix eliminated the problem of aan 
indefinite matrix. Potter's algorithm has been shown to have 
excellent numerical characteristics and was used 
successfully in several applications. Despite its numerical 
Stability, Potter's algorithm has found limited usage for 
several reasons: 

1. It takes more computational time and storage 
than the RLS algorithm. 
2. It can only handle scalar measurements. 

Andrews [1968] suggested the use of data whitening such 
that vector measurements can be implemented componentwise. 
He also suggested the use of triangular matrices to reduce 
the amount of computational time and storage. However, it 
was shown later that Andrew's algorithm does not preserve 
triangularity of the square-root covariance matrix and is 
equivalent to Potter's algorithm in the scalar case 
[Kaminski, Bryson and Schmidt, 1973]. 

The use of triangular square root matrices was further 
pursued by Carlson [1973]. Bierman [1976], on the other 
hand, approached the problem by using upper-diagonal 
factorization method. Even though both methods are 
algorithmically similar, U-D factorization is more efficient 
and avoids scalar square roots. Moreover, U-D factorization 
can be shown to be equivalent to Gentlemen's least-squares 


algorithm [Gentlemen, 1973], which is based upon the 
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numerically Stable and accurate Givens orthogonal 
transformation (Bierman, 197 Fin One drawback of U-D 
algorithm is that the updating formulae are not as compact 
as those of the original RLS algorithm, Tt is given in a 
FORTRAN like form, To illustrate this, equation (3.18) to 


equation (3.20) are rewritten as follows: 


@uay- 7 
Loeerese nity 2, =I 
Doecrk Sr, Uae | 
3 W(j) = w(j) + P(k, Fj) awk) 
2 b(j) = P(5,35)*W(4 
b(1) = P(1,1)*"W(1) 
am §6 + b(1)#*W(1) 
y = 1/a 
P(1,1) = P(1,1)*y«6 
VOean) Me 2, fit 
yp Mor 
asa b(4j)*yv(4) 
h= = W(4)#y 
y = 1/a 
P(j,3) = P(j,j)*pey 
Do 4k# 1, 3-1 
p= P(k, 3) 
P(k,j) = 6 + b(k)#*h 
4 blk) = b(k) + b(4) #6 
we 1 - ((6%6*2)/(aeZy) ) 
IF (i<Umin) Me™ Mmin 
Leet lm lp th te 
DS oak &) IFN 
5 P(j,k) = P(5,k)/u 
é@é = @/a 
DO 6) 1, nt 
6 6(35) = 6(j) + b(j)*e 
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The first Do-loop is equivalent to equation (3.15) and 
followed by the determination of the a posteriori estimation 
error. Do-loops 2, 3 and 4 update the covariance matrix and 
the gain. It should be noted that the gain x(k) in equation 
(3.20) has been substituted by «(k) of equation (3.17) in 
the algorithm. Also, update of the gain x(k) in equation 
(3.17) has been separated into two parts: the term 6 + 
VC kK) PC ke) ey kollee. whichte ing «SISO 'systemstastoniyl a 
scalar, 1S updated as a and the term P(k-1) wW(k-1) is stored 
under’ b. The original RLS algorithm uses 6 as 1, some 
authors suggest the use of 6 as the noise variance of the 
system and others prefer to replace it with the forgetting 
factor. In this work, the implementation in the simulation 
studies has used the noise variance as 6 and in the 
experimental results the value of 45=1 was used. Neither 
truncation nor indefinite covariance matrix problems were 
encountered in either case. After the covariance matrix is 
updated by the factorization method, it is again inflated in 
Do-loop 5 by the variable forgetting factor. This is 
important in order to control the speed of adaptation of the 
estimator. Finally, the parameter estimates are updated in 
Do-loop 6. Instead of adding a Do-loop to calculate the gain 
x(k) with b and a, the a posteriori estimation error is 
first divided by a before Do-loop 6. This step is taken to 
preserving the U-D efficiency. The algorithm can also be 
modified slightly to store the covariance matrix as a vector 


Such that storage can be reduced in large dimension 
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problems. 


Implementation of the adaptive PID controller with U-D 
factorization and variable forgetting factor algorithm is 
straightforward. It does not require any matrix inversion, 
matrix Square roots Or Seria. and error iterative 
cCakculatvons. ie involves only simple arithmetic and 
calculation of the control law is directly determined from 
the parameter estimates. Therefore, it is computationally 
efficient and suitable for a microprocessor based computer. 
Implementation of the algorithm requires the following steps 
recursively: 

1. Measurement of the process output y(k). 

2em Predict ionvofiGthettprdcess teoutpubesy (kya. eG 
Dozloonmis 

3. Calculation of the a posteriori estimation error 
6(k). 

4. Update of the covariance matrix P(k) and gain 
K(k), and determination of the forgetting factor 
jiCa be Wesyy aie llfexeje: 7) aatey AbferalWeyejs) ie 

5. Update of the parameter estimates O6(k), i.e. 
‘Blom MMoleje: (Shr, 

Gu Calculation of “the control law, i.e ..:equation 
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3.5 Summary 


thas chapter reviews the difficulties commonly 
encountered when RLS is used for closed-loop contro.) 
identification, and presents’ the use of U-D factorization 
method to implement RLS with a variable forgetting factor. 
Discussion on the problems of RLS begins with the decrease 
of estimator gain with respect to time when the _ process 
under control has been at steady-state for long duration of 
time, i.e. when the process has not been ‘persistently 
excited'. Thiseedifficultyebis gsolvedpeby auinuroducing@eia 
eConstantumrorqettingmtactor, Hhubeit isiiurthereseshovnisebopsbe 
inadequate and could lead to blow-up of the covariance 
matrix when the value of forgetting factor is less than 1. 
The use of a variable forgetting factor is then introduced. 
The final section discusses the numerical problems of RLS. 
It presents the use of U-D factorization algorithm as a 
solution and outlines the implementation steps of the 


algorithm with a variable forgetting factor. 
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4. Simulation Study 


4.1 Introduction 

TMaemobyectivesotethis —chaptermaisaetomeliictratcemtne 
properties of the adaptive PID controller presented in 
Ciaprerw-,meondee nigh lightesthe se actonse aewhichessscnomlomspe 
considered in the 'actual' implementation of the algorithm. 
Performance of the adaptive PID controller is evaluated 
through some simulation studies on a hypothetical system, 
which has also been considered by other authors [Vogel, 
1982; Seborg, Shah and Edgar, 1983]. In continuous-time 


domain, the model of this 'bench-mark' example is given as: 


y(s) en 


u(s) G35es 01) 9( 5s +1) 


where d is the system time delay ranging from 1 to 5. If a 
sampling interval of T,=1 is used, the corresponding 
discrete-time transfer function of the system with a zero 


order hold is represented by: 


y (k) Zee 0 a0 20m tO 0 26 ae) 
(4,2) 


u(k) i) = abpspelayear see doheclask eters» 


In addition, the load disturbance dynamics were modeled by 


the following continuous-time transfer function: 
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The corresponding discrete-time representation with T,=1 is 


given by: 


y (k) 0.09522"! 
LS Se selene eae (‘44s 
v(k) ieee. D047 a0 


The following simulation runs were performed to study 
the effects of: 
1. Constant and known time delay 
= Choice of initial b-parameters 5b(0) 
ss Cheoveenot ae 
- Choice of initial covariance matrix P(0) 
2. Constant but unknown time delay 
3. Unknown and varying time delay 
4. Disturbances and changing process gain 
5. Delay dominated systems 


on the closed-loop system performance. 


4.2 Constant and Known Time Delay 

When system time delay is known and constant, many 
different techniques are available in the literature to 
compensate for its effect on the overall closed-loop system 


performance. The Smith Predictor scheme, for example, is one 
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of the most widely used dead-time compensators. However, due 
to its sensitivity to modeling errors, a scheme using an 
adaptive algorithm to estimate the process model parameters 
and update the compensator was investigated. One of the 
methods proposed to handle time delay systems is to include 
additional numbers of Bb parameters in the process model to 
be estimated. The number of extra parameters can be either 
equal to the maximum estimated time delay in terms of 
sampling periods [Wellstead and Sanoff, 1981], or a possible 
range of time delay expected in the system, i.e. maximum 
minus minimum time delay [White, 1976]. The former becomes 
computationally unattractive when system time delay is 
large. This matter will be further examined in a later 
Section with respect to unknown and/or varying time delay 
systems. 

The following simulation runs were carried out to 
demonstrate the capability of the adaptive PID controller in 
handling systems with constant and known time delays. When 
the system time delay is said to be known, it also means 
that the number of extra parameters in polynomial B(z™') 
that need to be estimated are the same as the number of 
Sample periods of true delay,i.e. De=Da. Thevinitial 50 
sampling periods of the simulation runs are set at zero 
steady-state condition before any setpoint and/or load 
changes are introduced. During those periods, white noise 
(0,02) is added to the system with o7=0.005 and the control 


variable is constrained to |u(k)|<1.0. After the first 50 
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Sampling periods, the constraint on the control variable is 
changed to |u(k)|<i00 and a series of step changes are made 
in the setpoint to test the controller performance in 
tracking the desired trajectory. 

Figure 4.1 illustrates the simulated servo response of 
the system when the time delay is one sampling period, i.e. 
Da=1. Figure 4.2 and Figure 4.9 are the responses when the 
time delay is two and five sampling periods respectively. 
Though the control variable is clipped during the initial 50 
Sampling periods, simulation runs’ show that the control 
variable is well within the limit during those periods. The 
output variable is shown to follow the desired trajectory 
very closely in all cases. As the time delay increases, the 
amount of overshoot on the output variable increases. This 
is because of the longer period of uncertainty in the 
parameter estimates during the initial period. However, this 
overshoot decreases aS time increases (Figure 4.9). 

Figubemm=4.ca to Figure 4.3c show athe convergencescoft the 
estimated parameters when time delay is_ two sampling 
periods. Derivation of the Hadaptive PID controllers sin 
Chapter 2 indicates that the process model be a_ second 
order. There are therefore four parameters to be estimated 
in each caSe in addition to the extra parameters used to 
compensate for the time delay. For the case in Figure 4.3a 
to Figure 4.3c, it amounts to six parameters. Each parameter 
is shown to fluctuate during the initial period. This is 


expected since each parameter is initialized to zero except 
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for 6b3;(0). However, all parameters converge rapidly after 
the introduction of the first step change in the setpoint. 


Below is a list of the 'true' process parameters and the 


estimated parameters. 


Table 4.1. List of Parameter Estimates When System Time 
Delay is Known and Constant 


Parameter | 'True' Parameters | Estimated Parameters 


eal ryeces ell Hes: 
0.5866 Dey 
0.0 =—(0022 
03:0 0.0049 
0.0280 0.0240 
0.0234 0.0280 


The three PID controller settings are shown in Figures 4.4a, 
4.4b and 4.4c to behave in a similar fashion. This is due to 
the fact that they are determined from the estimated 
parameters according to equations (2.37), (2.38) and (2.39). 
Figure 4.5 shows the variable forgetting factor. The change 
imsthe Value of ‘forgetting factor 1s  sowtsmali @that Mit 
appears as if it stayed at a constant value at 1. The choice 
Grmthemlowermilimit of forgetting factor iS Bimporctantesa las 
point will be further disctssed in connection wath che 
choice of Zo. For all the simulation runs, the lower limit 
usesetmto.0, 9. 

The adaptive PID controller algorithm also provides an 
on-line tuning parameter, i.e. pole-location w,, to allow 
the operator to 'shape' the output response. A small value 


Of Ww, corresponds to fast rise time and a large value gives 
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Sluggish response. Since the value of £6, is used in place 
of B(z~') in equation (2.24), it follows that the control 
action is actually faster than it would have been with 
B(z~'). Due to this reason, it was found that small value of 
W; gives very fast rise time and causes the response to 
become soscim@eiatory. For the simulation studies, a 9 value of 


0.9 is used except for Figure 4.1 where w,=0.8. 


Choice of Initial b-Parameters Ib; 

From the control law described by equations (2.32) and 
(2.33),/it is obvious that initial parameter estimates. for 
the b's cannot be all set to zero since this implies that 
PheCweCOUCTOlMN Input during —the@uinitial  Spernoces wile be 
indefinite. To start the U-D estimation algorithm, all the 
initial parameters are therefore Set to zero except for one 
Parameter in polynomial B(z~'). Theoretically any one of the 
Bb parameters can be initialized to non-zero. To see if this 
is true, two simulation runs with different Bb parameters 
initialized to non-zero were carried out with the remaining 
conditions being identical. Both give similar results. 
Figure 4.2 shows the simulated response when B3 is 
initialized to a non-zero value, and Figure 4.6 shows the 


case when 6. is initialized to a non-zero value. 


Choice of Zo 
The value of Zp. given by equation fe She ase) is 


proportional to the nominal asymptotic memory length and the 
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System noise variance. From equation (3.13), a small value 
of Zo will cause the forgetting factor to decrease and it 
may even hit the minimum limit. A small forgetting factor 
corresponds to a large covariance. This implies that the 
System is sensitive to disturbances and speed of adaptation 
is faster in response to sudden parameter changes. However, 
small values of Zo do not necessarily give better control. 
For noisy systems, small values of EZ, will cause the 
forgetting factor to remain near the minimum limit most of 
the time and can thus create an oversensitive system. The 
value of ZX should, in this case, be chosen high enough to 
include the noise variance as dictated by equation (3.15). 
On the other hand, this observation also provides an 
indication as to which direction the value of Zp» should be 
changed to, i.e. to increase or decrease. Figure 4.2 and 
Figure 4.7 show the results of two different runs with Zo= 


and Z )=10 respectively. Both runs appear to be similar. 


Choice of Initial Covariance Matrix P(0) 

In general, a large initial covariance matrix indicates 
that the level of confidence in the initial estimates of the 
parameters is low and the estimator is thus required to 
response fast to parameter changes. When 4 priori knowledge 
about the controlled process is unavailable, as is often the 
case, the initial covariance matrix is usually set toa 
relatively large diagonal matrix. Using the U-D estimation 


algorithm, this choice is found to be insensitive. Figure 
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4.2 and Figure 4.8 give the closed-loop system responses 
with P(0)=10*I and P(0)=1071 respectively. Though Figure 4.8 
gives a higher overshoot during the first step change in 
setpoint, ENG@remeiS se practicalivyesnoOwm ditferencemmacme tine 
inewedsed..ssoinces the choice .of  P(0)) was mrounds tombe 
INSENSICIVG;e With the exception of Figure 4.8, the initial 
cOvatrancesmathix P(0) for allvsimulation “runsweiseeset | to 
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4.3 Constant but Unknown Time Delay 

For systems with unknown time delay, it is a common 
Practice to tune the controller by using the maximum value 
of the expected delay. Consequently, the system response 
often becomes sluggish. Two Simulation runs were performed 
to test the performance of the adaptive PID controller toa 
System with unknown time delay by overparameterizing and 
underparameterizing the polynomial CaS Us By 
overparameterization it is meant that the number of extra 
parameters is greater than the maximum expected time delay 
in terms of sampling periods. For example, if the maximum 
time delay is expected to be 4 sampling periods, instead of 
identifying 4 extra parameters in BCZ ew 
overparameterization identifies 5 or 6 extra parameters. 
Similarly, by underparameterization it is meant that the 
number of extra parameters is less than the maximum expected 
time delay. Using the above example, the number of extra 


parameters identified in underparameterization will be 
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anychninger rome «to 3. 


In Figure 4.10 the number of extra parameters is 
greater than the maximum expected time delay, i.e. six extra 
parameters. Comparison of this run to the one when time 
delay is known, Figure 4.2, shows similar responses. Figure 
4.11 displays the system performance when the number of 
extra parameters is less than the maximum expected time 
delay. The run in Figure 4.11 has employed two extra 
parameters in polynomial B(z Yj.) Theoretically weetnis 
indicates to the estimator that there are two sampling 
periods of delay. The actual time delay in the system, 
however, is five sampling periods. Nevertheless, giving a 
sequence of input-output history, the estimator will 
converge to a set of parameters which also minimizes’ the 
estimation error. Since the control law described by 
equations (2.32) and (2.33) uses only the value of ZB, and 
not the individual 56;, the ultimate effect is therefore 
equivalent. If this run is compared to Figure 4.9 with known 
time delay, it can be seen that the rise time during the 
first step change is faster with the consequence of a larger 
overshoot. This is due to a larger uncertainty during the 
initial “period in the parameter estimates. As time 
increases, Figure 4.11 shows smaller overshoot than Figure 
4.9 with no Significant difference, in, rise time. In 
addition, there is a significant amount of computational 


time to be gained in underparameterization since less 


Parameters are estimated. 
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Wellstead and Sanoff [1981] proposed to 
overparameterize the polynomial B(z-~') by the largest 
expected time delay. White[1976], on the other’ hand, 
recommended the overparameterization of polynomial B(z~') by 
an expected range of time delay to reduce the total number 
of estimated parameters. When the minimum expected time 
delay in White's approach is set to zero, the two approaches 
can be shown to be equivalent. The whole purpose of 
providing 4a priori estimation of the minimum time delay is 
to reduce the total number of parameters estimated when the 
maximum time delay is expected to@ebes largess The 
underparameterization scheme described above has 
demonstrated the independence of the adaptive PID controller 
performance from the total number of extra parameters in 
polynomial Bz). This algorithm is therefore 


computationally more efficient due to this fact alone. 


4,4 Unknown and Varying Time Delay 

Inspite of the difficulties they create in control 
problems, systems with unknown and/or varying time delay 
characteristics are often encountered in chemical processes. 
A typical example involves the transport delays in chemical 
processes which vary with the process flowrate. From section 
4.3, it is ‘shown that the adaptive PID controller can 
perform equally well even when the number of extra 
parameters estimated is less than the maximum expected time 


delay. Similar tests are performed for systems with unknown 
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and varying time delay and the results are given in this 
section. 

Figure 4.12 and Figure 4.16 show the performances of 
the adaptive PID controller when the system time delay is 
unknown and changes. In Figure 4.12, the time delay changes 
from two to five sampling periods at k=500, and only two 
extra parameters are included in polynomial B(z~'). When the 
time delay is five sampling periods, the number of extra 
parameters is no longer equal to the actual delay but less. 
However, system performance iS not degraded since the 
algorithm uses only the steady-state value, LD of 
polynomial B(z™'). 

When the time delay changes, though the process 
Parameters might be invariant, there is a mismatch in the 
process model that causes the parameters to change to 
accomodate for the total effect. The parameter convergence 
is rapid and is shown in Figure 4.13, 4.14a and 4.14b. For 
comparison purposes, the 'true' process parameters and the 
estimated parameters are listed in Table 4.2. Along with the 
changes of parameters at k=500, the estimation error 
increases. Consequently, the forgetting factor also 
decreases to allow the estimator to adapt faster to the 
changes. Once the parameters converge, the value of 
forgetting factor goes back to one. This is shown in Figure 
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Table 4.2. List of Parameter Estimates When System Time 
Delay is Unknown and Varying 


Estimated Parameters 


Parameter 'True' Parameters k<500 | k>500 
Vleet aaa o sre 
0.5866 OG teers 
Oreo UO ie ZU ous 
0.0 0.0031 O= 0057 
0.028 0.024 0.017 
0.0234 On03i1 0.014 


Time delay for k<500 = 
k>500 = 
Time delay was changed 


2 
5 
a 


t k=500 and T,=1 


Figure 4.16 gives the system response when the number 
of extra parameters iS made equal to the largest expected 
time delay. The resulting performance is good but 
computationally it is less attractive than the case shown in 
Figure 4.12. Though a maximum expected time delay is 
required to implement the adaptive PID controller, it is 
seen in the test runs that the number of extra parameters in 
polynomial B(z~') can be less than the maximum expected time 


delay. 


4.5 Disturbances and Changing Process Gain 

The combined closed-loop response for tracking and 
regulation is shown in Figure 4.17 without feedforward 
compensation. Unit step changes in setpoint are introduced 


at k=50, k=200 and k=650. In addition, step load 
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disturbances of magnitude equal to 0.5 are introduced at 
k=250 and k=500 for a period of 200 and 100 sampling 
intervals respectively. 

Figure 4.17 shows oscillatory response from k=320 to 
kK-d20-estnce the controller is) initially tuned = tomtrack 
setpoint alone, the introduction of first load disturbance 
changes the estimated parameters. The oscillations are 
therefore the consequence of this initial adaptation period. 
Moreover, the output response settles down at the desired 
trajectory before the step load disturbance is taken away. 
The oscillations are therefore not to be mistaken as_ the 
result of the second disturbance. When the step load 
disturbance is taken away at k=450, it represents a negative 
step load disturbance to the system. However, it can be seen 
from Figure 4.17 that the disturbance rejection action is 
very fast after the controller is tuned in. The second 
setpoint change is made to test the controller performance 
at setpoint tracking after it has tuned itself for 
disturbance rejection. 

In Figure 4.18 adaptive feedforward control is added to 
thevadaptive feedback PID controller for thessame ~cperating 
conditzons as in Figure 4.17.. For feedback ‘plus feedforward 
control, two additional parameters are estimated to model 
the measurable disturbance. The addition of feedforward 
compensation eliminates the oscillations and provides faster 


response than the one with feedback control alone. 
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Figure 4.19 shows the case when the process gain is 
changed from 1 to 2 at k=200. Step load disturbances of 
magnitude equal to 0.5 are again introduced at k=300 and 
k=450 for a period of 100 and 350 sampling intervals 
respectively. Unlike load disturbance, the changing of 
process gain changes the 'actual' process parameters. Since 
the estimator has found a set of convergence values for the 
a tia | process during the first step change, the 
introduction of a different process gain introduces a _ new 
set of system parameters. Consequently the estimation error 
increases, and the forgetting factor decreases to a lower 
value such that the estimator can discount the old data and 
put heavier weighting on the new information to adapt to the 
"new' system. As shown in Figure 4.20, the forgetting factor 
reaches the lower limit only when the eStimation error 
becomes large, and not at the instant when the sudden change 
in the process gain occurs. This 1S expected since the 
forgetting factor is determined based on the estimation 
error rather than the process gain. During the adaptation 
period, the output response becomes very oscillatory. 
Nevertheless, because of this excitation in the system which 
gives ‘rich’ information to the estimator, the controller as 


well tuned and the system response to the step _ load 


disturbances is quickly arrested. 
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4.6 Delay Dominated Systems 


To evaluate the performance of the adaptive PID 
controller on a delay dominated system, i.e. when d/r > 1, 
the time delay in the simulation model of equation (4.2) is 
increased from the previous maximum of 5T, to 8T,. The 
adaptive PID controller is then applied to this system with 
fe extra Parameters in polynomial” (B(z 1) The polynomial 
B(z~') is therefore underparameterized by 4 parameters. 
Figure 4.21 shows the result obtained for this application. 
Due to the large time delay in the system, the initial 
adaptation period is longer and the initial output response 
is oscillatory with high overshoot. However, it can be’ seen 
from Figure 4.21 that the output response tracks’ the 
setpoint very well after this initial tuning period. The 
initial oscillatory response can be avoided if the initial 
system identification is done in the background while the 


process is operating under a fixed gain controller. 


4.7 Summary 

This chapter discusses the results obtained from the 
Simulation studies on a 'bench-mark' example, and serves as 
a stepping stone to the experimental studies presented in 
the next chapter. The evaluation procedures are categorized 
into: i) systems with known and constant time delays; ii) 
systems with unknown but constant time delays; iii) systems 
with unknown and varying time delays; iv) load disturbances 


and systems with changing process gains; v) delay dominated 
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Systems. The discussions focus mainly on the choices of 
several initial parameters in order to start the algorithm, 
and the effects of these choices on the closed-loop 
asymptotic tracking and regulatory properties of the 
adaptive PID controllers Whe jmniutralvechoices fot tithe 
covariance matrix and the non-zero b parameter are found to 
Demon crit icaltenre. “P(0) canbe isetuto: ane lative bywelange 
identity matrix and the non-zero b parameter can be any one 
of the b parameters. Though not ‘sensitive, the tuning 
parameter w, is found to give best performance when a higher 
value is chosen, and a relatively large value of Zo should 
be chosen to prevent the forgetting factor from remaining at 
the lower limit. Also, the total number of extra parameters 
in polynomial B(z~') to handle time delay systems needs not 
be the same as the maximum expected time delay in the 
system. This property is particularly useful when dealing 
with © systems with unknown and varying time? delays. it 
reduces a lot of computational time when time delay is 
large. The adaptive feedforward compensator is also studied 
and found to improve the output performance considerably. 
Finally, the adaptive PID controller is found to work well 


even when it is applied to a delay dominated system. 
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5. Experimental Evaluation 


Seat n CLOaduCct1 ON 


To evaluate the adaptive PID controller performance on 
a real process, the algorithm was implemented on a HP-1000 
digital computer to control the temperature of a continuous 
stirred-tank heater. This chapter outlines the process 
equipment and control hardware that were used to 
experimentally evaluate the adaptive PID control algorithm 


and discusses the results obtained. 


5.2 Description of Equipment 

The continuous stirred-tank heater used in this study 
is located in Room 274B of the Chemical-Mineral Engineering 
Building at the University of Alberta. A detailed 
description of the equipment is also available in Lieuson, 
Morris, Nazer and Wood [1980] and Thesen [1981]. A schematic 
diagram of the equipment is shown in Figure 5.1. The tank is 
15 cm in diameter and 55 cm in height. The temperature of 
city water used as the inlet cold water ranges from 11°C to 
18°C depending upon the outdoor temperature and is measured 
by thermocouple A. Since city water is used in the entire 
building for other process equipment and the inlet flowrate 
is merely monitored by a hand valve, fluctuations on _ the 
inlet flowrate are inevitable. Inlet flowrate, measured by 
an orifice/mercury manometer, is maintained at 8.2 kg/min 


during steady-state operations. Parallel to the manometer is 
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a differential pressure cell which provides the flowrate 
measurement Signal to the computer. 

A constant holdup of approximately 8.2 kg is maintained 
in the tank by a level controller. The inlet cold water is 
heated by saturated steam at a pressure of 50 psig. The 
pneumatic control valve on the steam line is an _ equal 
percentage type and thus gives rise to a non-linear 
relationship between the input air pressure and the’ steam 
flowrate. The outlet water temperature can be measured by 
either thermocouple B, C, D or E. The thermocouples, as seen 
in Figure 5.1, are located at different points on the outlet 
Pipe to deliberately introduce different time delays in the 
system. Only one thermocouple can be used at a time and is 
selected through a switch box as shown. A load disturbance 
is introduced into the system by changing the inlet 
flowrate. By so doing, it also changes the outlet flowrate 
to maintain a constant holdup. Changes in outlet flowrate 
cause the time delay to vary since the major system time 
delay is the transportation delay. 

Except for cases where changing time delays are 
involved, thermocouple E is used for the experimental study 
described here. The choice of this sensor location in 
preference to the others is because it gives the longest 
time delay. Relationship between the inlet flowrate and the 


time delay is calibrated for thermocouple E and is given by: 
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Where d is the system time delay in seconds and R is the 
inlet flowrate in kg/min. 

The process is interfaced to a HP-1000 digital computer 
ine the: “Data Acquisition, ~ Control» sands: Simulation: (DACS) 
Centre ini the Department» cof Chemical, Engineering» at the 
University of Alberta. The thermocouple signal in millivolts 
is converted to a current signal of 4 to 20 milliamperes 
(mA). The corresponding 1 to 5 volt output developed across 
a resistor is then 'read' by the analog-to-digital (A/D) 
converter. The control signal from the digital computer, on 
the other hand, is. sent to a current-output-station (COS) 
which also serves as a zero-order hold device. The output 
frompcthnesCOSeis a4 to) 20emAesignaliuthisacurrent sagnal sas 
Phenpeconvertede! tor at,S t toe iSepsig  airapressuressignalgio 
position the control valve » through a  current-to-pressure 


(I/P) converter. 


5.3 Experimental Results 

The experimental results obtained by using the adaptive 
PID controller are compared to those obtained by using 
conventional discrete, fixed gain, PID controller. No 
attempts are made to compare the adaptives PilDrgconzroiier 
performance with the self-tuning PID controller performance 


proposed earlier in the literature [Wittenmark and Astrom, 
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1980; Isermann, 1981; Corripio and Tompkins, 1981; Gawthrop, 
1982; Banyasz and Keviczky, 1982; Hetthéssy, Keviczky and 
Banyasz, 1983; Astrom and Hagglund, 1983; Cameron and 
Seborg, 1983; Song, 1983], since the earlier works are not 
designed to handle unknown and/or varying time delay 
systems. The major emphases on the evaluation are: to study 
the controller performance in handling systems with unknown 
but constant or varying time delay; and to study the 
disturbance rejection properties of the controller. The 
results are presented in the following order: setpoint 
tracking for a) known and constant time delay system b) 
unknown and constant time delay system c) unknown and 
changing time delay system; and disturbance rejection with 
and without feedforward compensation. 

As mentioned in the previous chapters, when the process 
is represented by a first order plus time delay model, the 
resultingcontroller structure -issequivalent ito thatroft 4the 
conventional discrete PI controller. Experimental runs with 
the adaptive PI controller were also conducted to evaluate 
its performance. 

Initially the process parameter estimation was done in 
the background while the process was operating under a fixed 
gain PI controller. This was done to avoid excessive control 
action during the initial period. When a process is unknown, 
the initialized parameters generally contain large errors. 
Since the controller design uses the certainty-equivalence 


principle, the control algorithm accepts the current 
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estimates without considering their uncertainty. 
Consequently, the inttival cConcroL action might be 
meaningless. Hard limits on the control valve are placed at 
20 and 100% valve opening. The thermocouples are calibrated 
for 25°C to 55°C. Below 20% valve opening, the temperature 
in the tank is below the calibrated range. Due to the 
background estimation, the parameter estimates can be 
initialized to zero. However, in order to be consistent with 
the simulation runs, the last two b parameters for a second 
order delay model and the last b parameter for a first order 
delay model are initialized to one. This choice also avoids 
large initial transients in the control valve. The fixed 
gain PI controller settings are Ke=3.5%valve/°C and 


Ke=O0007SeCue . 


5.3.1 Constant and Known Time Delay 

Figure 5.2 shows the stirred-tank heater response just 
after being switched from fixed gain PI controller to the 
adaptive PID controller. The outlet temperature is measured 
with thermocouple E which also introduces the longest 
transport delay. With a sampling interval of 4 seconds as 
used in Thesen [1981], the total delay is estimated to be 4 
Sampling periods. In the case of known time delay, four 
additional 6b parameters are estimated. The desired 
closed-loop system pole is located at z=0.9, the value of Zo 
is chosen to be 5, and the initial covariance matrix 1s 


1071. Convergence of the estimated parameters are shown in 
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ProuLem on oa,e oes 52sec and Sade Though the parameters 
converged to constant values during the fixed gain PI 
controller period of operation, they fluctuate again at the 
time intervals related to the setpoint changes. This is 
expected since the adaptive controller settings are 
determined from the parameter estimates and the setpoint 
change has served to reactivate the estimator. The 
fluctuation during the first setpoint change is the largest 
and then the changes become smaller at each subsequent 
setpoint changes. This implies that parameter convergence 
has eventually occurred. 

The adaptive PID controller settings are plotted in 
Figure 5.4a, 5.4b and 5.4c. Small changes in the parameter 
estimates lead to large jumps in the controller settings as 
shown around k=400, k=800 and k=1280. These changes in the 
estimates can be explained as a result of the choice of Zo 
and consequently the value of forgetting factor. As_ seen 
from Figure 5.5, the large spikes in the controller settings 
occur when the forgetting factor stays near the lower limit 
for some time. When the forgetting factor is less than 1 for 
a period of time, it increases not only the covariance 
matrix but also makes the estimator adapt faster to the 
changes in the system. When this happens while there are no 
changes in the system, it can lead to oscillatory response 
and, in the worst case, an unstable system. On the other 
hand, this also indicates that Zo should be increased to a 


higher value to prevent the forgetting factor from remaining 
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at the lower limit when there are no changes in the system 
(cf. Figure 5.24). It should be emphasized that the choice 
of 2) also depends on the initial parameter estimates 
obtained under the control of fixed gain controller. This 
run 1S chosen to illustrate the tuning effect of £5. Above 
all, it is chosen to show the 'robustness' of the adaptive 
PPDeconutrol ler, 

Under similar process operating conditions as in Figure 
Weapeadaptive Plgcontroller is used to “control thew outrler 
temperature of the stirred-tank heater. Comparable results 
to Figure 5.2 are obtained and are given in Figure 5.6. The 
resulting controller settings are shown in Figure 5.7a and 
Figure 5.7b. 

Fixed gain discrete PID controller is used as a basis 
to compare the performance of the adaptive PID controller. 
The stirred-tank heater response using fixed gain PID 
controller is shown in Figure 5.8. The controller settings 
are estimated by IAE technique [Miller, Lopez, Smith and 
Murrill, 1967] and after fine tuning, the values are found 
to be Kce=5%valve/°C, K;,=0.005sec°' and Ty=10sec. Better 
performance by both adaptive PI and PID controllers is 
evident. Fixed gain PID takes a longer time to reach 
steady-state and gives higher overshoots with longer rise 
time. Theoretically, the faster response given by both 
adaptive PID and PI controllers is due to the summing effect 
of the 6 parameters. By replacing the polynomial B(z~') of 


equation (2.24) with Zb,, the response 1S d1teferent »sinemtne 
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transient stage (steady-state matching is always easy to 
do). In addition, since the use of Eb, in place of B(z™') 
removes the delay, it follows that the control action is 
faster than it would have been with B(z-'). 
9.3.2 Constant but Unknown Time Delay 

When the time delay is unknown, it is difficult to 
determine the number of extra Bb parameters required to _ be 
estimated. To evaluate the adaptive PID(PI) controller 
performance in such a situation, the time delay of the 
Stirred-tank heater is assumed to be unknown. Although the 
actual time delay is 4 sampling periods with sampling 
interval of 4 seconds, the number of extra Bb parameters was 
intentionally specified to be different than 4. In this 
section, two different runs with two and six extra 
parameters are used. 

Figure 5.9 and Figure 5.11 show the stirred-tank heater 
responses using adaptive PID controller when the number of 
extra 6b parameters are two and six respectively. Similarly, 
Figure 5.10 and Figure 5.12 show the stirred-tank heater 
responses using adaptive PI controller with the rest of the 
operating conditions remain unchanged. The large initial 
variations in the input-output responses are due to the 
uncertainty in the initial controller parameters. From 
equations (2.33), (2.37), (2.38) and (2439)), though the 
desired closed-loop poles are pre-selected, eiey=p SAID) 


controller constants will vary according to the parameter 
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estimates. Therefore, it is expected to have these large 
variations during the initial period until parameter 
convergence occurs. At the same time, it is also clear that 
a parameter estimation algorithm with fast convergence 
property is the most desirable. Though there are more 
variations in the input and output responses during the 
initial period for the adaptive PI controller, all responses 
show excellent performance. of the adaptive PID(PI) 
controller regardless of the number of extra 6 parameters. 
This property of the adaptive PID(PI) controller is very 
Significant, in particular for systems with unknown and/or 
changing time delay dynamics. Comparison of the adaptive PID 
and PI control in Figure 5.9 to Figure 5.12, however, shows 
the better performance by the adaptive PID control. This is 
probably because of the presence of time delay and also the 
assumption of a lower order model for PI control, i.e. a 


first order model. 


5.3.3 Unknown and/or Changing Time Delay 

The time delay of the stirred-tank heater can be varied 
by using different thermocouples to measure the outlet 
temperature. When the sampling interval is 4 seconds, the 
system time delay varies from _ one sampling period at 
thermocouple B to two sampling periods at thermocouple C and 
four sampling periods at thermocouple E. In this jesection,; 
the number of extra 6 parameters are chosen to be three. The 


reason for this choice is again to illustrate the 
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performance of the adaptive PID(PI) controller in the 
presence of time delay mismatch. More Specifically, it 
assumes that system time delay is unknown. 

Figure 5.13 shows the response of the stirred-tank 
heater just after being switched from the fixed gain PI 
controller to the adaptive PID controller. The time delay 
during the first three setpoints is four sampling periods. 
At the fourth setpoint change, the time delay is changed to 
two sampling periods by switching thermocouples. Finally, 
the time delay is changed to one sampling period at the 
Sixth setpoint change. When three extra 6 parameters are 
used in the estimation model, it is theoretically indicating 
to the estimator that there is a delay of three sampling 
periods in the system. Ideally, the three leading 5 
parameters will be zero or close to zero for a delay of 
three sampling periods. In the presence of noise, however, 
it is difficult to distinguish between zero and non-zero 
Darameters. # in addition, the actual time delay sin@thveucase 
is changing from four to two and one sampling period. This 
error in the delay model makes the differentiation between 
zero and non-zero parameters even harder. Giving a sequence 
of input and output measurements, the estimator will 
optimize the pre-specified model parameters, i.e. minimize 
the estimation error. Since only the value of £5, is used in 
the control law calculation, the problem of distinguishing 
between zero and non-zero parameters is thus avoided. 


Despite the slow response at the first setpoint change, 


et2 ab - 


sk eee — 


ingt-besttze 9e2 io = 
i? tieo Bbexit aie G61! Sie 
ysiek <ni2 oft oa bhasenioy an @ 
<thOi~sg «6enél gete Sal 2 hh 
a3 Bugrsd= af gates chs en? , 
viianes =of out monn 
oi4 36° hoissg pre? Tague sit oP ¢ 


Me ersfenessg © axis aevisr na ann 
igzibal ¢iiesizerasare ae tr, I sthontiabdriees cae ods — 
oni lowes seutt, de ary “6 2 = 3908 gto bar 
i pHibgei: SSRT) ethene gies Bybi sotege’ aa3 ar 8 
7 = 

é yveleSD cs 26b S18R bo? secko aan ia od fitv sab 


tevencn .geror o aanagees ont fe 


3tea-00 hits, .o7as gasevjed fist 


afa- @iat ni 35 mig. cu 2 38 ait apie 


F ie 


sint . ,beiteq piilqaer gnc Sade et) 
Ty 1olIek2RegeDILh oo aden 
gndsupse «& i have a 
Litw tossnb as oo: 
szieinin Baht wee 


er bien dt? am : 
enedelanotent® 


= —_ 


124 


(G=0S/B6'0=M/)'c y=80/E=80) 
Jajjouqu0o Qidq aAiqdepe Bulsn asuodsau vaqeay yUBI-PauIIS “EL'G aunBl4 


A IWAHSLNI SNIdNVS 
2aSt B21 228 Zar 


2 AaT 


2 -ap 


2 AS 


ONINSdO SN IVA Fo 


Gil fal ASHE 


x JAVRST Sl JSMAd. 
. | aslontaes Ci svitgebs onieu saneqgs: edeed dned~berige .2ec aqvar, 7 aan 


a 


125 


excellent performance is obtained at the Subsequent setpoint 
changes. The corresponding adaptive PID controller settings 
are shown in Figure 5.14a, 2. 14D5 Band o>. ecemmetne 
corresponding forgetting factor is plotted in Figure 5.15. 
At the instant at which setpoint changes are 
introduced, there are small variations occur in Kc. These 
variations are more obvious when the setpoint change is 
accompanied by a change in the time delay, e.g. at k=690. 
Larger variations are also encountered when the time delay 
is changed from 2 to 1 sampling period, e.g. at k=1350. 
These initial variations in Ke are due to the mismatch in 
the time delay model, in particular the 6b parameters. For 
convinience, equations (2.37);,. (2.38 )bandm (2.39) are 


rearranged here as: 


LW j 
Kc = ——— (a, ate 2a2) Gon 2) 
Wy zB, 
a2 Aue 
tT, = 7° oOo i553) 
a, + 2a2 


T, = - ———— (5.4) 


When time delay varies, the process dynamics change and _ so 
do the parameter estimates. Since the sum of Bb parameters 
appears in the denominator of equation (5.2), any changes in 


this sum will lead to significant variations in Kc. As shown 
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Mmeduatitonse 55.3) and (5.4) = the values of Te eandslamace 


effected only by the sample time and the A parameters. 
However, it should not be assumed that the values of Tasand 
T; are independent of time delay. This is because the 4 
parameters also vary with time delay (see Table 4.2). 

Figure 5.16 shows the stirred-tank heater response 
controlled by an adaptive PI controller, and Figure 5.17 
shows the stirred-tank heater response under the control of 
a fixed gain PID controller. Variations in the stirred-tank 
heater response are larger with the fixed gain PID 
controller. It also takes a longer period of time to reach 
steady-state whenever a setpoint change is made. For this 
reason, Figure 5.17 shows only 5 setponit changes eventhough 
the total number of setpoint changes are essentially the 
Same as the rest of the runs for unknown and/or varying time 
delay case. In Figure 5.17, the initial time delay is 
estimated to be four sampling periods. This time delay is 
changed to two sampling periods at the second setpoint 
change, and then changed to one sampling period at the 
fourth setpoint change. 

The system time delay is also varied in the reversed 
direction, i.e. from one sampling period at thermocouple B 
to four sampling periods at thermocouple E. Figures 5.18, 
5.19 and 5.20 show the corresponding stirred-tank heater 
responses with an adaptlvesP>iDecontroller > an adaptive PI 
controller and a fixed gain PID controller respectively. The 


Same observations as mentioned above apply with respect to 
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the performance of fixed gain PID controller. If frequent 
setpoint changes are required, the best performance is 
obtained with the adaptive PID or PI controllers. 

One possible drawback of adaptive controllers, in 
general, is that variations in the controller output are 
larger than those of the fixed gain controller. Self-tuning 
regulators, for example, have characteristics that result in 
excessive control action. This leads to the introduction of 
a weighting function on the control action in the 
performance index, resulting in the so-called 'generalized' 
self-tuning controller. Pole-placement controllers, on the 
other hand) @lintit shel ycontrolk) action ® bymwplacing.« the 
closed-loop poles in appropriate locations. However, as 
found in this experimental study, the adaptive PID(PI) 
controller still gives slightly noisier control input than 
the fixed gain PID controller even when the response has 
reached steady state. This can be explained as follows. The 
adaptive PID(PI) controller takes the form of equation 
(2.25) where the present and past output measurements and 
setpoint are multiplied by Kc. Any small changes in Ke due 
to slight variations in the parameter estimates will give 
rise to ‘slight variations in the ‘control input. |) Many 
different techniques can be used to eliminate the small 
variations in the control input. One commonly used method is 
to filter the control input, e.g. by using an exponential 
filter or a velocity limiting filter. Another possible way 


fem tomtilter ‘the "parameter estimates. The filtered 
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parameters can then be used to calculate the PID controller 
settings, however the unfiltered parameters would still be 
used for the next estimation. Since the PID controller 
settings are determined from the parameter estimates, it is 
also possible to filter the controller settings directly 
instead of the parameter estimates. Other methods to reduce 
the noise in the control input can also be found in the 


literature, e.g. Goodwin and Sin [1984]. 


5.3.4 Disturbance Rejection 

At steady-state operation a mass flowrate of the inlet 
cold water of approximately 8.2 kg/min is maintained. To 
evaluate the adaptive PID controller performance in the 
presence of load disturbances, step load disturbances are 
introduced into the system by varying the inlet flowrate by 
leek mit. 

Figure 5.21 shows the stirred-tank heater response to 
step disturbances in the inlet flowrate by using an adaptive 
PID controller. The corresponding step changes in the inlet 
flowrate is shown in Figure 5.22. At the point of switching 
from fixed gain PI controller to the adaptive PID 
controller, i.e. at the first step change in setpoint as 
SHOWNMIIIEE TOUC emo. Ql peter ral.Ue uncertainty in the estimated 
parameters results in the lowest possible forgetting factor 
value (Figure 5.24). Consequently, large variations occur in 
the controller settings during this initial tuning period. 


The controller settings are given in Figure 5.23a, 5.23b and 
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From the plot of the controller settings, the 
controller gain Kc increases toa higher value after the 
disturbances are introduced. This is due to the fact that 
the controller is first tuned to track setpoint changes. 
Theoretically, the controller gain is higher when tuning for 
regulatory purposes, for example open-loop methods with IAE 
Ore ITAR tuning criteria. Form@the stirred-tank heater, 
however, a negative step change in inlet flowrate does not 
increase thetcontroller gain as Bmuch as ay positives: step 
change. This can probably be explained as follows. Due to 
the small heating surface and the open-top tank, it takes a 
longer period of time to heat up the fluid inside the tank 
than to cool it down, i.e. a non-linear system. When the 
inlet flowrate is increased, the temperature drops. If the 
controller gain were to remain constant, it would take a 
longer period of time to heat the fluid temperature up to 
the steady-state level. Figure 5.26 shows the stirred-tank 
heater response with a fixed gain PID controller and Figure 
5.27 shows the corresponding changes in the inlet flowrate. 
Comparison of Figure 5.26 to Figure 5.21 shows the slower 
response of the fixed gain PID controller with respect to 
both regulatory and servo control. A Similar test was also 
carried out on an adaptive PI controller, and the result is 
shown in Figure 5.25. The better performance by the adaptive 
PID(PI) controller is expected, since the adaptive PID(PI) 


controller is capable of adjusting its controller settings 


sis yegis wale oud i nae 
said 406 =@# G2 - wh i 
@e790ms tnbeqenr. 23032 as 
cot pattws sede retig tif si cae f 
a4! dite eboseeq qool-ege sta 
otean dneehestisay sett 20% Ge vas 
sao eeob etutwolt sakee nt spied esi pvitepen s 4 oY word 
sate evistesq. & 8 eum ca nteg. debestno> a. 
os su@ .vutfet a6 Belalane sd eldagona feo sift 
a stat JE | ee qoi*asuc of) bee: eaetoua gniteed in 7 
‘cot aay ahpend BiG? ad? av sweet of) emi? fo bolieq 

of? wait ,aeeee: agetticvon 4 oy avob 21 toon od ia 
ais 2: ,zaowk o1g Te1eghes 2h: beuapaatt e! ererwolt 408 ay 
4 oNe: bApe 2? GRAETCS réapar 8e amp alep set lorine: 
af gu eweskeqded Gwen: sted ante: % totieg + f 


be te . 7 
(net-6a7 abe -_— eae at .é: srght qfaret osare-ybabae) as 


ae = 


rf 


snagia toa cai Fecnsem9 ire clep benit 9, dts eancqead 19 

-ermtwos? assim ae nk eepoeto peliipgestie> sdz 21 ia 15 

1860%8 ad3 svete a. of! a soa to monk rat 
susqeen a4 beeen eh ae aa 


~ 


145 


(OL=0S/6°0=M/?=80/E=9Q) ‘PJyO"M yaljouquod |q adiqdepe 
Hulsn saouequngasip d3aqas 04 aSuodSdu vaqeay yUeI-PdUIIS °G2Z’G aunbl4 


> IWAHSLNI SNIdGNVS 
Bagt aa2t 228 Oar 


‘ac 


“AV 


"29 


“B28 


“BAT 


Op 


QNINSdO SA IVA 


Jo dWal 


oes f ye 


4 JAVRST ANGMAR 


onieuv soured welt qeis od seriaqeo) Istser aned-Dp Mice 25.2 Stage. 
[Or=o2\8.G2W\bseli\E=a0) BA.ow lethal evipgsbha 


146 


(OL=P1/GO0'O0=!4/G=9y/7=eQ) Cid uleh paxis 
Bulsn saouequngasip daqs 09 asuodsau vageay yUeI-PpaulaS “G2°G aunGbil4 


M IWAWSLNI SNIdNVS 
Bagot Beet altel = Bar 


“Be 


“Av 


"AS 


“28 


“AaT 


Me 


“OV 


"2S 


ONINSdO SA IVA Fo 


Jo dWal 


eS 
4 JAVRSTA GMINA 


~ 


_ Gileu edqnerwizih aade of senuQde? Toseart dnae-banig2 35.8 ong 
(Ot <bT\200.0<DAG=oA\h<eG) GS ‘nisg. best 7. - 


147 


(Ob=P1/GO0'0=!4/G=9/P=!8C) Aid uwleb paxil} Sulsn 
Jaqeay YUBI-PauulgS aya 09 paonpouqu! SaoueguNysip daays */2°G aunBbil4 


> IWAHSALNI SNIdGNVS 
Zagt Aazt 228 mar 


ap = 


ujw/O6> 3LVed MO lS 


ww Ses. see 
” JAVRSTM OUEMAS 


a 
: : Aetaer sinet-bevite art o¢ Geoutioiwnl esaaadwoeih gare NS eg 7 
(Or=pT\200,022\a-o" hae CFF nia bowlt gala 


148 


to both servo and regulatory control situations. Though the 
IAE technique [Miller, Lopez, Smith and Murrill, 1967] has 
different formulae to tune the fixed gain PID controller for 
servo and regulatory controls, the fixed gain PID controller 
used in all the experimental runs here was fine-tuned to 
accomodate for servo and regulatory controls as well as 
system non-linearity. 

When the load disturbances are measurable, an adaptive 
feedforward compensator can be included in the adaptive PID 
controller. To implement this algorithm, two additional 
Parameters are added to estimate the dynamics of the 
disturbance. The adaptive feedforward compensator, however, 
consists of a single gain term as described in Chapter 2. 

To evaluate the improvement it provides over the 
adaptive PID controller alone in the presence of load 
disturbances, the inlet flowrate measurement was provided to 
the computer and a similar run to Figure 5.21 was made with 
the adaptive PID controller plus the adaptive feedforward 
compensator. The resulting stirred-tank heater response is 
shown in Figure 5.28 with the step load disturbances shown 
in Figure 5.29. It is shown that the addition of the 
adaptive feedforward compensator improves the closed-loop 
system response considerably. However, it takes a longer 
period to track a setpoint change after the controller has 
been tuned in the regulatory control situation. Since the 
feedforward compensator is designed to improve regulatory 


control in the presence of a measurable disturbance, a 
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retuning period is required for the first encounter of a 
setpoint change. 

Figure 5.30 shows the stirred-tank heater response for 
a 2.5 hour run in which there is only one setpoint change 
during the initial period, i.e. after being switched from 
the fixed gain PI controller to the adaptive PID controller. 
This run is conducted to see the effect of long steady-state 
operation on the parameter estimates and hence the 
controller settings. The adaptive PID controller settings 
are shown in Figure 5.31a, 5.31b and 5.3 1c. 


When the parameter estimates have converged to a set of 


values which minimize the a posteriori estimation error, 
variations in the forgetting factor value should be minimal. 
Theoretically, the forgetting factor should converge to a 
value of 1 at steady state (equation 3.19). Small variations 
im the forgetting factor, however, do occurszand could be 


caused by the presence of the system noise. This is shown in 
Figure 5.32. At steady state, the term (Wt (k-1)P(k-1) 
w(k-1)) in equation (3.19) approaches zero. Equation (3.19) 


is thus represented by: 


é7(k) 
(555) 


Lo 


Gincesithe value of Loe iseprespecmiied the value of the 
forgetting factor uw is solely dependent on the a _ posteriori 


estimation error. Even when the parameter estimates have 
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eonverged tos alsisetsiios values, if the estimations’ are 
corrupted by noise, the a posteriori estimation error will 
be small but not zero. This could also be caused by the 
accumulated roundoff error of the finite word length 
computer. The accuracy of the 16-bit words HP-1000 digital 
computer for single precision is 6 significant digits: 
Therefore, the value of the forgetting factor varies 
slightly even at steady state. These small variations in the 
forgetting factor further leads to ‘small changes in the 
controller settings. Variations in Ke can be seen in Figure 
vena; buty thei value of- Kc® is*ibounded) withins aviwvaliue! of 4° to 


5% 


5.4 Summary 

This chapter describes the stirred-tank heater and 
control hardware that were used to experimentally evaluate 
the adaptive PID and PI control algorithms. It also presents 
and compares the results obtained by using the adaptive 
PID(PI) controller with the conventional, fixed gain, 
discrete PID controller. The adaptive PID(PI) controller is 
ehowniwto goutperform «they fixedigqain’ PID) control lerpingadd 
cases, i.e. for the case of a known and constant time delay, 
an unknown but constant time delay and a varying time delay. 
Moreover, the adaptive PID(PI ) controller ensures 
closed-loop asymptotic tracking and regulation even in the 
presence of finite and unmeasurable sustained load 


disturbances. The initial choice of the covariance matrix is 
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found to be non-critical. The pole location w, gives the 
desired small overshoot when it is initialized to a higher 
Moa LUG wae ~Glamew,=0.8 or 0.9. The initial value of Zo, though 
not sensitive, should be chosen high enough such that the 
forgetting factor would not remain at the lower limit. From 
this study, it is also found that the value of the 
forgetting factor during the commissioning period is a good 
indication as to which direction the value of Zp) should be 
changed to, e.g. increase Zo when the value of forgetting 
Factor remains near the lower limit or when yi is 
fluctuating wildly during the steady-state operation (cf. 
Higure ~ 5.5) shatThey addi tioneéct tean ecadantive feedforward 
compensator improves not only the output response but also 
smooths the control actions, at the expense Gas two 
additional parameter estimates. The adaptive PID(PI) 
controller can be started with the initial parameter 
estimation done in the background, while the process is 
controlled bydagiaxedw gain gecontuollenmeisknowledge Igctatthe 
initial process parameters is therefore unnecessary, and the 
adaptive PID(PI) control algorithm can be either used as an 
adaptive controller or as a tuning algorithm for the fixed 
gain PID(PI) controller. It is also clear then, that the 
adaptive PID(PI) controller can replace the existing fixed 
gain PID(PI) controller in industry, especially when 


retuning of the controller settings is frequently needed. 
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6. Conclusions and Recommendations 


6.1 Conclusions 


An adaptive PID(PI) controller has been successfully 
developed, implemented and evaluated. The resulting 
controller has the following properties: 

= It is structurally and mathematically equivalent 

to the conventional discrete PID(PI) controller. 

as It is robust and ensures asymptotic closed-loop 

tracking and regulation even in the presence of 

sustained unmeasured load disturbances, setpoint 
changes and/or modeling errors. 

= For measurable disturbances, it can be used with 
an adaptive feedforward compensator. 

= It uses the computationally efficient and 
numerically stable U-D factorization algorithm 
in combination with a variable forgetting factor 
to perform the parameter estimation. Simulation 
and experimental results show the excellent 
performance of this combination. 

2 The use of the variable forgetting factor allows 
tracking of slowly time-varying parameters, and 
avoids blow-up of the covariance matrix during 
long steady-state operation. In addition, it 
provides an on-line tuning parameter, Zo, to 
control the speed of adaptation. 


- The algorithm has another on-line tuning 
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Parameter, w;,, to place the desired closed-loop 
pole, and hence allows the operator to 
"shape-up' the desired output response. 

The performance of the adaptive PID(PI) controller is 
first evaluated through some simulation runs. Experimental 
studies, however, are essential as a follow-up for two major 
reasons: they can further justify the Simulation 
conclusions; they often lead to new insights and thus 
complete the entire evaluation procedure. For instance, all 
adaptive controllers require some kind of initial parameters 
before they can be operated. From the simulation runs, it is 
found that the initial parameter estimates could be 
initialized to zero except for one 56 parameter. The 
experimental studies, however, reveal that this could lead 
to undesired large variations in the initial closed-loop 
System response and might even lead to unstable response. 
Usually the initial parameters can be obtained either 
analytically, by lisimulation;miby cateprioriegvexperimental 
Studies or by experience. For the adaptive PID(PI) 
GOnGLOULET, the experimental studies found that the 
initialization method in the simulation runs could still be 
used if background estimation was performed during the 
initial period while the process was controlled by a_ fixed 
gain PID(PI) controller. 

The application of the adaptive PID(PI) controller to 
the stirred-tank heater shows the superior performance of 


the adaptive PID(PI) controller. The adaptive PID(PI) 
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controller is therefore a logical tcandidates.forkeuse in 
industrial processes where conventional discrete PID(PI) 
control is being used, in particular when ReEtuning ease hetthe 
controller settings is frequently needed. In addition to its 
use aS a 'stand-alone' adaptive controller, the adaptive 
PID(PI) control algorithm can also be used as a retuning 
algorithm for the existing conventional discrete PID(PI) 
controllers. 

Despite the amount of research activity in the adaptive 
control area, the number of applications of adaptive control 
in industrial processes is still very few. One of the 
reasons EStedue» toesinsufficient -eimsight. fFandesthus® the 
unwillingness to risk the expensive plants by applying 
modern control techniques. Derivation of the adaptive 
PID(PI) controller reveals two significant points, which 
should help tostill thisvvoerd: 

= Compared to fixed gain PID controllers, adaptive 
controllers are sophisticated. However, they can 
be interpreted in a fundamental classical linear 
feedback control theory framework. In its 
simplest form, the adaptive controller proposed 
here has been shown in this work to be 
structurally and mathematically equivalent to a 
conventional discrete PID(PI) controller. 

= Though an adaptive controller is capable of 
learning the process and adjusting its 


controller settings automatically, it should not 
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be regarded as a 'magic blackbox' and should be 


used properly and accordingly. 


The software developed to implement computer control of 


the Stirred-tank heater uses. the multiprogram feature 


Supported by HP-1000 computer system. This feature allows 


the operator to make any changes through the operator 


console without suspending the control cycle. It is easy to 


use and modify for experimental evaluations of any adaptive 


and/or fixed gain control algorithm. 


6.2 Recommendations 


The following recommendations regarding future work can 


be made: 


Further experimental evaluations of the adaptive 
PID(PI) controller on time-varying systems 
and/or non-minimum phase systems should be 
performed. The controller should also be applied 
to multivariable system by configuring it as 
multi-loop controller. 

To provide easiness of industrial testing, the 
adaptive PID(PI) control algorithm should be 
implemented on a_ portable microprocessor-based 
computer. 

Stability and convergence analysis on the 
adaptive PID(PI) control algorithm. 

Theoretical investigation on robustness issues, 


for example additional Bb parameters to handle 
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unknown and/or varying time delay systems. 

Since a scalar variable forgetting factor 
represents. only a measure of the total 
information content in the estimator, one has no 
cOnerol son, show “thiseetoral information is 
distributed among the Various parameters. 
Therefore, the possibility of using a vector of 
variable forgetting factors to control this 
information distribution should be investigated. 


from those stated above, improvements on the 


Stirred-tank heater are also recommended. These include: 


Installation of a flow controller on the inlet 
cold water line. This is mainly to avoid sudden 
large variations on the inlet flowrate when 
other laboratory equipments are in usSe. 
Replacement of the proportional level controller 
by a PI controller to eliminate the existing 
offset. 

Expansion OCOfGethetirange.,of the “vCeémperatune 
transmitter to allow for a wider operating 
range. ‘This °is due tothe large variations in 
the cold water temperature from the winter 


months to the summer season. 
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